-- Logs begin at Wed 2022-06-22 08:01:08 UTC, end at Wed 2022-06-22 09:23:33 UTC. -- Jun 22 08:41:04.534348 dv-cinder-787296-11-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 08:41:04.542385 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 08:41:04 2022] *** Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: nodename: dv-cinder-787296-11-iscsi Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: machine: x86_64 Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: clock source: unix Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: pcre jit disabled Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: detected number of CPU cores: 4 Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: current working directory: / Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: detected binary path: /usr/bin/uwsgi-core Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: your processes number limit is 47680 Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: your memory page size is 4096 bytes Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: detected max file descriptor number: 2048 Jun 22 08:41:04.544818 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: lock engine: pthread robust mutexes Jun 22 08:41:04.545685 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: thunder lock: enabled Jun 22 08:41:04.545685 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 08:41:04.545685 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 08:41:04.590409 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: Python main interpreter initialized at 0x560920f559c0 Jun 22 08:41:04.590409 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: python threads support enabled Jun 22 08:41:04.590409 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: your server socket listen backlog is limited to 100 connections Jun 22 08:41:04.590409 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: your mercy for graceful operations on workers is 90 seconds Jun 22 08:41:04.590740 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 08:41:04.590835 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: *** Operational MODE: preforking *** Jun 22 08:41:04.591107 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: *** uWSGI is running in multiple interpreter mode *** Jun 22 08:41:04.591107 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: spawned uWSGI master process (pid: 80298) Jun 22 08:41:04.591316 dv-cinder-787296-11-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 08:41:04.592406 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: spawned uWSGI worker 1 (pid: 80310, cores: 1) Jun 22 08:41:04.592406 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: spawned uWSGI worker 2 (pid: 80311, cores: 1) Jun 22 08:41:04.592406 dv-cinder-787296-11-iscsi devstack@keystone.service[80298]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 08:41:10.102608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:41:10.102608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: from cryptography.utils import int_from_bytes Jun 22 08:41:10.103352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:41:10.103352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: from cryptography.utils import int_from_bytes Jun 22 08:41:10.104142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:41:10.104142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: from cryptography.utils import int_from_bytes Jun 22 08:41:10.104589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 08:41:10.104589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: from cryptography.utils import int_from_bytes Jun 22 08:41:10.153135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:41:10.153327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:41:10.153523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] command line args: [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:41:10.153795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:41:10.153977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ================================================================================ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:41:10.154096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 08:41:10.154262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] admin_token = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.154347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 08:41:10.154466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] command line args: [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 08:41:10.154546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] config_dir = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.154691 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.154772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 08:41:10.154877 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] config_source = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.154960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ================================================================================ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 08:41:10.155184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] admin_token = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.155258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] debug = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.155394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.155639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] config_dir = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.155639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.155765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.155823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] config_source = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.155958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] debug = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_config_append = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.156982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_dir = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] log_config_append = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157762 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] log_dir = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.157907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] log_file = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158066 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158641 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.158965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.159953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.160067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.160187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.160314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.160420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.160559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.160647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.160835 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.160959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.161115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.161327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.161416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.161514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] publish_errors = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.161751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.161915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] publish_errors = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] standard_threads = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.162973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] standard_threads = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163619 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_journal = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.163907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_json = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_stderr = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] use_journal = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_syslog = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] use_json = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] use_stderr = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] use_syslog = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.164874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 08:41:10.164955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.165131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.165207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.165367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.165443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.165627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.165701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.165867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.165943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.166144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.166223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.166386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.166460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.166635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.166711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.166871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.166946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.167118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.167194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.167353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.167433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.167600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.167681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.167836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.167924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.168083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.168163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.168321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.168403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.168558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.168638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.168803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.168888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.169040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.169122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.169294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.169369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.169534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.169616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.169780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.169855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.170019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.170120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.170307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.170464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.170596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.170709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.170854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.170928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.171103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.171193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.171336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.171412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.171566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.171641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.171799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.171884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.172984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.173059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.173232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.173351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.173480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.173583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.173713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.173813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.173954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.174970 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.175109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.175186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.175339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.175426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.175570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.175646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.175806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.175888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.176045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.176135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.176282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.176366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.176523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.176600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.176763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.176841 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177563 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.177954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.178996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.179151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.179229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.179391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.179467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.179625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.179710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.179859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.179941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.180092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.180176 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.180334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.180409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.180574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.180658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.180807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.180887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.181997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.182098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.182263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.182350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.182504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.182581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.182739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.182816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.182977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.183053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.183222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.183302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.183458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.183546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.183696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.183777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.183937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.184962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.185115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.185194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.185370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.185445 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.185608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.185694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.185848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.185930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.186120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.186711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.186884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.187016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.187124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.187294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.187449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.187532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.187694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.187778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.187925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.188932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.189096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.189181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.189332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.189455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.189580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.189657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.189818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.189903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.190085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.190164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.190325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.external = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.190400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.190560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.190652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.190789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.external = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.190864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.191020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.191127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.191301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.password = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.191378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.191535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.token = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.191618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.191776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.191895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.password = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.192016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.192128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] auth.token = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.192267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.192352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.192502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.192579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.192752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.192829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193085 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193557 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.193966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.194050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.194242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.194319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.194483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.194572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.194764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.194850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.195001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.195078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.195267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.195354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.195523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.195600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.195765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.195843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.196020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.196105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.196257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.196333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.196514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.196600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.196796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.196877 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.197040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.197116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.197299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.197378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.197540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.197618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.197780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.197859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.198993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.199071 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.199239 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.199317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.199476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.199553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.199731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.199834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.199972 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.200222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.200341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.200463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.200588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.200714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.200836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.200963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.201074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.201203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.201322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.201443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.201570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.201692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.202480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.202591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.202736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.202813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.203062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.203138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.203298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.203384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.203538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.203616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.203791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.203868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.204976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.205054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.205224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.205300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.205470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.205557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.205726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.205802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.205967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.206044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.206261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.206339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.206501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.206583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.206740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.206816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.206973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.207985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.208145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.208220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.208391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.208469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.208620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.208695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.208867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.208942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.209111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.209189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.209341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.209417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.209582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.209660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.209816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.209894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.210043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.210136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.210303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.210380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.210544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.210622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.210781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.210856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.211967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.212999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.213164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.213240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.213400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.213478 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.213635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.213710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.213873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.213950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.214127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.214209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.214370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.214446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.214617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.214692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.214848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.214925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.215092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.215167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.215324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.215407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.215563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.215641 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.215797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.215876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.216953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.217031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.217199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.217274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.217481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.217564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.217780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.217908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.218093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.218169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.218287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.218365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.218528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.218608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.218774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.218852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.219963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.220985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.221145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.221222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.221378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.221461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.221613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.221690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.221845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.222003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.222135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.222286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.222364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.222532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.222609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.222767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.222852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.223048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.223136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.223298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.223376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.223558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.223637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.223800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.223877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.224048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.224125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.224289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.224367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.224529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.224607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.224769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] role.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.224847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] role.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] role.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.225965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] role.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.226043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.226222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.226300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.226473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.226551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.226719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.226795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.226966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.227042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.227211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.227288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.227443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.227519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.227690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.227767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.227935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.228012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.228182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.228258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.228411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.228487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.228658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.228809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.228906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.229048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.229152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.229302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.229388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.229554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.229777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.229854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.230014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.230119 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.230291 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.230368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.230541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.230618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.230791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.230876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.231981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.232059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.232220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.232305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.232452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.232530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.232685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.232762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.232923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.233007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.233730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.233857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.233985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.234109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.234252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.234343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.234492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.234569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.234725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.234809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.234963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] token.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.235048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.235201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.235324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.235449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.235526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.235686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.235772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.235941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.236982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.237151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.237235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.237387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.237464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.237626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.237701 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.237863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.237946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.238140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.238221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.238392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.238469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.238664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.238755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.238915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.238994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.239157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.239271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.239401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.239534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.239624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.239781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.239867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.240975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.241053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.241212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.241298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.241450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.241526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.241694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.241771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.241939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.242023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.242196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.242275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.242442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.242518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.242682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.242770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.242844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:41:10.242915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.243148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.243380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.243619 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.243855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 08:41:10.244025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 08:41:10.274463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.274691 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.274928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.275303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.275536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.275760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.284106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.285172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.311904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.312134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.313325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.313559 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.464943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.465237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.514946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.515182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.515960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.516456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.581910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.582159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.582248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.582384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.582467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.582605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.582706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.582815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.582895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.583026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.583105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.583235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.607958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.608594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.608710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.608829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.609015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.609152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.609277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.609400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.609527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.609650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.609781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.609905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.610028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.610184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.620858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.621080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.634104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.634341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.634469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.634592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.634727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.634857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.634984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.635106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.635231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.635368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.635507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.635652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.635805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.635805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80310) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 08:41:10.652972 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.653182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:41:10.653520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.653601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.653722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:41:10.653803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:41:10.653993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.654097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.654276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 08:41:10.654395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.654534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.654614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.654794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.655417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.655599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.655852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.666132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.666412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.666685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.666770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.666961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.667043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.667226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.667504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.675832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.676442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.679147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.679431 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.679716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.679798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.679992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.680073 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.680272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.680367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.680532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.680614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.680801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.680881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.681054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.681142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.681324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.681404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.681593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.681671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.681854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.681933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.682144 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.682407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.708461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.708714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.710088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.710333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.710415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.710608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.715662 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.715977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.716061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.716287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.716367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.716631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.724203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.724410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.724493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.724691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.728966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.729142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.729251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.729420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.729533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.729693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.729815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.729966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.730114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.730262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.730393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.730533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.730665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.730797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.730935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.731059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.750348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.750619 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.750703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.750918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.755293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.755633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.758888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.759284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.759372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.759682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.764380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.764731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.768212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.768622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.771863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.772163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.772296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.772440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.772603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.772716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.772890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.772974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.773177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.773267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.773456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.773736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.792591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.792866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.793137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.793333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.793415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.793615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.793881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.794178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.801801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.802712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.803513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.803800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.804412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.804698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.807081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.807358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.807633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.807907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.807987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.808178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.808259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.808459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.808743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.809038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.821354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.821634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.821916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.822217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.822383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.822607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.822898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.823180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.823807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.824096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.824396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.824807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.825099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.825383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.842280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.843957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.846327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.847292 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.849568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.850617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.851312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.852431 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.852917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.853192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.853470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.854090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.854372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.854650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.861414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.862735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.863035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.864340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.866249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.866533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.866917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.867190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.867602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.867895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.868280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.868560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.876256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.876533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.876806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.877788 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.878163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.878462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.884602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80310) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.884875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.885148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.885415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.885682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.886074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.886326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 08:41:10.886452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.886592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.886717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.886870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.887008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.887140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.887271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.887394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.887518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.887640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.887770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.887901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.888027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.888150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80310) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.888273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.888535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.888823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.889098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.889392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.889659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.889938 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 08:41:10.929591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560920f559c0 pid: 80311 (default app) Jun 22 08:41:10.932894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560920f559c0 pid: 80310 (default app) Jun 22 08:41:10.933028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08926cc2-3a4f-447c-97a2-08428d6ffa9b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:10.933321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08926cc2-3a4f-447c-97a2-08428d6ffa9b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:10.933602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08926cc2-3a4f-447c-97a2-08428d6ffa9b None None] PATH_INFO: `/v3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:10.938127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Wed Jun 22 08:41:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:19.603344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5f9c6-be9e-4e43-bc64-1644390bc040 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:19.603922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5f9c6-be9e-4e43-bc64-1644390bc040 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:19.603922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5f9c6-be9e-4e43-bc64-1644390bc040 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:19.608305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:19.614293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:19.619523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:19.619523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:19.684568 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: INFO dbcounter [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] Registered counter for database keystone Jun 22 08:41:19.706876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG oslo_db.sqlalchemy.engines [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:41:19.713116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writer thread running {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:41:19.892085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG passlib.handlers.bcrypt [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80311) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 08:41:19.892730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG passlib.handlers.bcrypt [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80311) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 08:41:19.946883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:19.948478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:20.070129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 22 08:41:20.237669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5f9c6-be9e-4e43-bc64-1644390bc040 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:20.308007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: INFO dbcounter [None req-c9b5f9c6-be9e-4e43-bc64-1644390bc040 None None] Registered counter for database keystone Jun 22 08:41:20.327264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG oslo_db.sqlalchemy.engines [None req-c9b5f9c6-be9e-4e43-bc64-1644390bc040 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 08:41:20.333997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writer thread running {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 08:41:20.452488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5f9c6-be9e-4e43-bc64-1644390bc040 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:20.458683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dff1bf-d114-4c6d-bb83-7613cd1272f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:20.459603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dff1bf-d114-4c6d-bb83-7613cd1272f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:20.460018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dff1bf-d114-4c6d-bb83-7613cd1272f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:20.460425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dff1bf-d114-4c6d-bb83-7613cd1272f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:20.468688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dff1bf-d114-4c6d-bb83-7613cd1272f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:20.520712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING keystone.common.rbac_enforcer.enforcer [None req-54dff1bf-d114-4c6d-bb83-7613cd1272f3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 08:41:20.520994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dff1bf-d114-4c6d-bb83-7613cd1272f3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:20.530452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Jun 22 08:41:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 08:41:20.536560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:20.551151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02909-9810-493d-a0a9-e4a6f7a445cc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:20.555567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091ab42-9683-42dd-86f5-36fe878248be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:20.556668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091ab42-9683-42dd-86f5-36fe878248be admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:20.556952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091ab42-9683-42dd-86f5-36fe878248be admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:20.557227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091ab42-9683-42dd-86f5-36fe878248be admin admin] PATH_INFO: `/v3/projects/4ead886d5c674d14a096a137e80b192b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:20.558729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091ab42-9683-42dd-86f5-36fe878248be admin admin] RBAC: Authorizing `identity:get_project(project_id=4ead886d5c674d14a096a137e80b192b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:20.612611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8091ab42-9683-42dd-86f5-36fe878248be admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 08:41:20.612954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091ab42-9683-42dd-86f5-36fe878248be admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:20.617594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Jun 22 08:41:20 2022] GET /identity/v3/projects/4ead886d5c674d14a096a137e80b192b => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:22.651355 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fb13-b07c-4b84-816c-c3868d670cc1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:22.651904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fb13-b07c-4b84-816c-c3868d670cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:22.651904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10fb13-b07c-4b84-816c-c3868d670cc1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:22.655998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:22.661806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afacca-5762-4574-adef-0004b238d044 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:22.662276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afacca-5762-4574-adef-0004b238d044 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:22.662450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afacca-5762-4574-adef-0004b238d044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:22.680836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d6afacca-5762-4574-adef-0004b238d044 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:22.682380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d6afacca-5762-4574-adef-0004b238d044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:22.690745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 08:41:22.713524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10fb13-b07c-4b84-816c-c3868d670cc1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:22.725812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10fb13-b07c-4b84-816c-c3868d670cc1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:22.730106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755f16-739f-4ff9-bc79-5644fc0a6720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:22.730743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755f16-739f-4ff9-bc79-5644fc0a6720 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:22.731034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755f16-739f-4ff9-bc79-5644fc0a6720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:22.731318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755f16-739f-4ff9-bc79-5644fc0a6720 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:22.739518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755f16-739f-4ff9-bc79-5644fc0a6720 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:22.741281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755f16-739f-4ff9-bc79-5644fc0a6720 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:22.750003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Jun 22 08:41:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 08:41:22.755939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afacca-5762-4574-adef-0004b238d044 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:22.764802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afacca-5762-4574-adef-0004b238d044 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:22.770045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db760dec-0de2-4857-af62-c3175f313c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:22.770919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760dec-0de2-4857-af62-c3175f313c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:22.771207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760dec-0de2-4857-af62-c3175f313c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:22.771487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db760dec-0de2-4857-af62-c3175f313c20 admin admin] PATH_INFO: `/v3/users/4eee573b0bd94bdf970811c775ee4f22` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:22.772870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db760dec-0de2-4857-af62-c3175f313c20 admin admin] RBAC: Authorizing `identity:get_user(user_id=4eee573b0bd94bdf970811c775ee4f22)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:22.774704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db760dec-0de2-4857-af62-c3175f313c20 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:22.776251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Jun 22 08:41:22 2022] GET /identity/v3/users/4eee573b0bd94bdf970811c775ee4f22 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:24.878324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62245f6-315a-4792-bc72-6f20206b93e6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:24.878811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62245f6-315a-4792-bc72-6f20206b93e6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:24.878882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62245f6-315a-4792-bc72-6f20206b93e6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:24.880234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:24.885344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6a52d-425f-4624-b48d-3ccd652755ab None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:24.885754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6a52d-425f-4624-b48d-3ccd652755ab None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:24.885991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6a52d-425f-4624-b48d-3ccd652755ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:24.900285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5b483-8430-490d-9d02-647821397f79 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:24.900569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5b483-8430-490d-9d02-647821397f79 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:24.900847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5b483-8430-490d-9d02-647821397f79 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:24.902217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:24.903639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-85d6a52d-425f-4624-b48d-3ccd652755ab None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:24.904899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-85d6a52d-425f-4624-b48d-3ccd652755ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:24.908445 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:24.908736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:24.909017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:24.949147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG passlib.handlers.bcrypt [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80310) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 08:41:24.949580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG passlib.handlers.bcrypt [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80310) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 08:41:24.987969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:24.995223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:24.996821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:25.012012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6a52d-425f-4624-b48d-3ccd652755ab None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.037047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:25.097872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:25.116418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6a52d-425f-4624-b48d-3ccd652755ab None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.119884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.151137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e0b74-39da-44d3-93ab-1a4bf7d4da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.151939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0b74-39da-44d3-93ab-1a4bf7d4da8f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.152227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0b74-39da-44d3-93ab-1a4bf7d4da8f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.152509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e0b74-39da-44d3-93ab-1a4bf7d4da8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.163932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e0b74-39da-44d3-93ab-1a4bf7d4da8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-934e0b74-39da-44d3-93ab-1a4bf7d4da8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:25.175966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:25.177104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:25.178038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:41:25.182921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e0b74-39da-44d3-93ab-1a4bf7d4da8f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.222352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf1f0-d868-4a81-841b-424ef78b86f6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.224618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:25.261456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28cf3f-5642-4aae-986d-0a0efad8b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.262386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28cf3f-5642-4aae-986d-0a0efad8b699 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.262676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28cf3f-5642-4aae-986d-0a0efad8b699 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.262959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28cf3f-5642-4aae-986d-0a0efad8b699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.266883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:25.284740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e0b74-39da-44d3-93ab-1a4bf7d4da8f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.319967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.320633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.320923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.321201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.321960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:25.322304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:25.323699 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:25.331525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28cf3f-5642-4aae-986d-0a0efad8b699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:25.333025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28cf3f-5642-4aae-986d-0a0efad8b699 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:25.336222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:25.341721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.430666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:41:25.436280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28cf3f-5642-4aae-986d-0a0efad8b699 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.438952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:25.443338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59a5ab-ecdf-457a-bf5a-22e1c206678e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.477464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a09ccc-e857-4df0-95ff-1092e486e075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.478481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a09ccc-e857-4df0-95ff-1092e486e075 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.478776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a09ccc-e857-4df0-95ff-1092e486e075 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.479056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a09ccc-e857-4df0-95ff-1092e486e075 None admin] PATH_INFO: `/v3/users/4eee573b0bd94bdf970811c775ee4f22` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.480270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a09ccc-e857-4df0-95ff-1092e486e075 None admin] RBAC: Authorizing `identity:get_user(user_id=4eee573b0bd94bdf970811c775ee4f22)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:25.481742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a09ccc-e857-4df0-95ff-1092e486e075 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:25.483426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/users/4eee573b0bd94bdf970811c775ee4f22 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:25.490343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a09ccc-e857-4df0-95ff-1092e486e075 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.505340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:25.537185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28cf3f-5642-4aae-986d-0a0efad8b699 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.571088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.571878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.572159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.572439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.589996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a09ccc-e857-4df0-95ff-1092e486e075 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.590613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:25.592055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:41:25.615356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:25.616215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:25.617012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:41:25.617012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:41:25.617012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:41:25.617012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:25.617012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:41:25.622312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.624899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fdeb-0e98-4dee-9b63-c3514f99616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.625750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fdeb-0e98-4dee-9b63-c3514f99616e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.626039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fdeb-0e98-4dee-9b63-c3514f99616e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.626577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fdeb-0e98-4dee-9b63-c3514f99616e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.628498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fdeb-0e98-4dee-9b63-c3514f99616e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:25.629954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fdeb-0e98-4dee-9b63-c3514f99616e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:25.631819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:25.637212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fdeb-0e98-4dee-9b63-c3514f99616e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:25.681099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:25.716099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:25.725855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d93f42-2e8c-4f58-a66d-280b8d480c82 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.735415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fdeb-0e98-4dee-9b63-c3514f99616e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:25.759656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1759276-79e1-45e1-b80b-1a55f4c839b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.760323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1759276-79e1-45e1-b80b-1a55f4c839b7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.760613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1759276-79e1-45e1-b80b-1a55f4c839b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.760891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1759276-79e1-45e1-b80b-1a55f4c839b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.761617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1759276-79e1-45e1-b80b-1a55f4c839b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:25.761969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1759276-79e1-45e1-b80b-1a55f4c839b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:25.763373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1759276-79e1-45e1-b80b-1a55f4c839b7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:25.770018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed115818-e961-4151-9659-e07c4fd54d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:25.770704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed115818-e961-4151-9659-e07c4fd54d0d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:25.770993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed115818-e961-4151-9659-e07c4fd54d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:25.771270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed115818-e961-4151-9659-e07c4fd54d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:25.772107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed115818-e961-4151-9659-e07c4fd54d0d None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.domain.id=default, user.id=4eee573b0bd94bdf970811c775ee4f22) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:25.772424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed115818-e961-4151-9659-e07c4fd54d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:25.773854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed115818-e961-4151-9659-e07c4fd54d0d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:25.780589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/role_assignments?user.id=4eee573b0bd94bdf970811c775ee4f22&scope.domain.id=default&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:25.781139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:28.199623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd82e4-3668-4788-9b4b-caa7081beb8a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.200108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd82e4-3668-4788-9b4b-caa7081beb8a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.200108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd82e4-3668-4788-9b4b-caa7081beb8a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.201438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:28.215657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5d02-4fc7-45dd-a75e-6f0852058f8c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.216105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5d02-4fc7-45dd-a75e-6f0852058f8c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.216285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b5d02-4fc7-45dd-a75e-6f0852058f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.239565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f43b5d02-4fc7-45dd-a75e-6f0852058f8c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:28.240776 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f43b5d02-4fc7-45dd-a75e-6f0852058f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:28.276983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9889-86f4-45ff-9085-2962001ad4c1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.277604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9889-86f4-45ff-9085-2962001ad4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.278127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb9889-86f4-45ff-9085-2962001ad4c1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.279690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 13/23] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:28.286387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ea8a-703e-4658-9e16-57c96b02ed04 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.286932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ea8a-703e-4658-9e16-57c96b02ed04 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.287404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ea8a-703e-4658-9e16-57c96b02ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.319061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cae0ea8a-703e-4658-9e16-57c96b02ed04 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:28.320607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cae0ea8a-703e-4658-9e16-57c96b02ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:28.330357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:28.331719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24b808-8d62-4970-9e4a-38530f10daad None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.332012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24b808-8d62-4970-9e4a-38530f10daad None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.332294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24b808-8d62-4970-9e4a-38530f10daad None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.333579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 12/25] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:28.345525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155318-41c9-4b54-9f70-991a443f252c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.345870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155318-41c9-4b54-9f70-991a443f252c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.346152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1155318-41c9-4b54-9f70-991a443f252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.369417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e1155318-41c9-4b54-9f70-991a443f252c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:28.371168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e1155318-41c9-4b54-9f70-991a443f252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:28.421682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:28.470860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:28.473839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1155318-41c9-4b54-9f70-991a443f252c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:28.479698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 22 08:41:28.529942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ea8a-703e-4658-9e16-57c96b02ed04 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:28.630814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1155318-41c9-4b54-9f70-991a443f252c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:28.639035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:28.665996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ea8a-703e-4658-9e16-57c96b02ed04 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:28.679240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640a88c-26ba-46f9-acfe-cea73d4af612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:28.680047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640a88c-26ba-46f9-acfe-cea73d4af612 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.680335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640a88c-26ba-46f9-acfe-cea73d4af612 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.680612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640a88c-26ba-46f9-acfe-cea73d4af612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.696134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640a88c-26ba-46f9-acfe-cea73d4af612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8640a88c-26ba-46f9-acfe-cea73d4af612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:28.708501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:28.709550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:28.710461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 14/28] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:28.711077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640a88c-26ba-46f9-acfe-cea73d4af612 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:28.711741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7160-53c4-4b26-aa78-39448bc46e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:28.712706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7160-53c4-4b26-aa78-39448bc46e73 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.713136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7160-53c4-4b26-aa78-39448bc46e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.713549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7160-53c4-4b26-aa78-39448bc46e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.725536 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7160-53c4-4b26-aa78-39448bc46e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:28.727231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7160-53c4-4b26-aa78-39448bc46e73 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e12e7160-53c4-4b26-aa78-39448bc46e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:41:28.748015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:28.749039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:28.749926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:41:28.749926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:41:28.749926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:41:28.749926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:28.751553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:41:28.751647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:28.753102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac19-429b-4230-8557-c477e6cc315b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.753582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac19-429b-4230-8557-c477e6cc315b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.754046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fac19-429b-4230-8557-c477e6cc315b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.755544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:28.760272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fac19-429b-4230-8557-c477e6cc315b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:28.839872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640a88c-26ba-46f9-acfe-cea73d4af612 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:28.879797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc9bf3-9390-4f4d-b307-1bf69c93ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:28.880469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9bf3-9390-4f4d-b307-1bf69c93ed55 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.880756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9bf3-9390-4f4d-b307-1bf69c93ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.881179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9bf3-9390-4f4d-b307-1bf69c93ed55 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.881891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc9bf3-9390-4f4d-b307-1bf69c93ed55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:28.883434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc9bf3-9390-4f4d-b307-1bf69c93ed55 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:28.900810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fac19-429b-4230-8557-c477e6cc315b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:28.929510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:28.938655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:28.939686 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:28.940112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:28.940527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:28.941434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:28.941888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:28.943466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:28.951705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 17/31] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:28.952639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:29.055235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd06fe-ee18-4565-b323-0f1ef88a79fd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:29.091828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:29.092762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.093213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.093631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.094587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:29.095186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:29.096881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:29.106609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 15/32] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 22 08:41:28 2022] POST /identity/v3/roles => generated 219 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:29.106609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fef660-5f96-49c9-afb4-69762de457bf None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.106609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fef660-5f96-49c9-afb4-69762de457bf None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.106609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fef660-5f96-49c9-afb4-69762de457bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.137541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f8fef660-5f96-49c9-afb4-69762de457bf None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:29.139258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f8fef660-5f96-49c9-afb4-69762de457bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:29.147545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 18/33] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:29.148336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:29.242895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:29.302675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 16/34] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:29.304230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fef660-5f96-49c9-afb4-69762de457bf None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:29.311194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544763bb-04d8-41d9-b0c6-7821033f6e93 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:29.337072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:29.352435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001ca1-580f-4ea7-afad-cfecaca766ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:29.353570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001ca1-580f-4ea7-afad-cfecaca766ae None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.354035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001ca1-580f-4ea7-afad-cfecaca766ae None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.354588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001ca1-580f-4ea7-afad-cfecaca766ae None admin] PATH_INFO: `/v3/users/4eee573b0bd94bdf970811c775ee4f22` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.355944 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001ca1-580f-4ea7-afad-cfecaca766ae None admin] RBAC: Authorizing `identity:get_user(user_id=4eee573b0bd94bdf970811c775ee4f22)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:29.357921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001ca1-580f-4ea7-afad-cfecaca766ae None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:29.359766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 19/35] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:29 2022] GET /identity/v3/users/4eee573b0bd94bdf970811c775ee4f22 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:29.361015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001ca1-580f-4ea7-afad-cfecaca766ae None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:29.423420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fef660-5f96-49c9-afb4-69762de457bf None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:29.461345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848748-0d4c-4c4b-83b3-1652533b66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:29.462019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848748-0d4c-4c4b-83b3-1652533b66c2 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.462341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848748-0d4c-4c4b-83b3-1652533b66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.462624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd848748-0d4c-4c4b-83b3-1652533b66c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.463608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd848748-0d4c-4c4b-83b3-1652533b66c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:29.465194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd848748-0d4c-4c4b-83b3-1652533b66c2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:29.477783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001ca1-580f-4ea7-afad-cfecaca766ae None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:29.497837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:29.518402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75218dd3-bd94-4923-b2c5-1f8f6801c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:29.519513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75218dd3-bd94-4923-b2c5-1f8f6801c709 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.520080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75218dd3-bd94-4923-b2c5-1f8f6801c709 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.520627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75218dd3-bd94-4923-b2c5-1f8f6801c709 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.521583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75218dd3-bd94-4923-b2c5-1f8f6801c709 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:29.523210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75218dd3-bd94-4923-b2c5-1f8f6801c709 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:29.605202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 17/36] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:41:29 2022] POST /identity/v3/projects => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:29.610234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848748-0d4c-4c4b-83b3-1652533b66c2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:29.703916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:29.730312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd848748-0d4c-4c4b-83b3-1652533b66c2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:29.773206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5442-84ac-46ff-9dbf-3dce3c7a1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:29.774051 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5442-84ac-46ff-9dbf-3dce3c7a1d64 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.774790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5442-84ac-46ff-9dbf-3dce3c7a1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.775729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5442-84ac-46ff-9dbf-3dce3c7a1d64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.777082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5442-84ac-46ff-9dbf-3dce3c7a1d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:29.778640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5442-84ac-46ff-9dbf-3dce3c7a1d64 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:29.780659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 18/37] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:29.781774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac914eb-7cca-46dc-8b46-320d1866aca6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.782082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac914eb-7cca-46dc-8b46-320d1866aca6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.787357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac914eb-7cca-46dc-8b46-320d1866aca6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.788978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 19/38] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:29.789770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac914eb-7cca-46dc-8b46-320d1866aca6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:29.894758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 22 08:41:29 2022] POST /identity/v3/roles => generated 225 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:29.896602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ceb4-238d-4dc0-9595-d8966a93386e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.896905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ceb4-238d-4dc0-9595-d8966a93386e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.897191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9ceb4-238d-4dc0-9595-d8966a93386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.915940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9ec9ceb4-238d-4dc0-9595-d8966a93386e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:29.917760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9ec9ceb4-238d-4dc0-9595-d8966a93386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:29.920015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac914eb-7cca-46dc-8b46-320d1866aca6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:29.961480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f39c3a-4ed8-4031-b80d-d90ef281fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:29.962820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f39c3a-4ed8-4031-b80d-d90ef281fb14 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.963319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f39c3a-4ed8-4031-b80d-d90ef281fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.963596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f39c3a-4ed8-4031-b80d-d90ef281fb14 None admin] PATH_INFO: `/v3/domains/default/users/4eee573b0bd94bdf970811c775ee4f22/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:29.965976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f39c3a-4ed8-4031-b80d-d90ef281fb14 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4eee573b0bd94bdf970811c775ee4f22, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:29.967476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f39c3a-4ed8-4031-b80d-d90ef281fb14 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:29.997638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 21/40] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:29.999157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e7a-c908-41d8-8bc2-2166d21feb82 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:29.999456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e7a-c908-41d8-8bc2-2166d21feb82 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:29.999824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3e7a-c908-41d8-8bc2-2166d21feb82 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:30.005664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 22/41] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:30.007387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51525-a2cc-418e-871e-1db6dd797cc8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:30.007684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51525-a2cc-418e-871e-1db6dd797cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:30.007962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b51525-a2cc-418e-871e-1db6dd797cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:30.026578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e2b51525-a2cc-418e-871e-1db6dd797cc8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:30.027797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e2b51525-a2cc-418e-871e-1db6dd797cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:30.083386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 20/42] 10.222.0.36 () {58 vars in 1361 bytes} [Wed Jun 22 08:41:29 2022] PUT /identity/v3/domains/default/users/4eee573b0bd94bdf970811c775ee4f22/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:41:30.095138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f39c3a-4ed8-4031-b80d-d90ef281fb14 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:30.100479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 23/43] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:30.107739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:30.124976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b51525-a2cc-418e-871e-1db6dd797cc8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:30.165641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:30.221724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f39c3a-4ed8-4031-b80d-d90ef281fb14 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:30.240657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b51525-a2cc-418e-871e-1db6dd797cc8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:30.268228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c091d-9395-49d0-a997-bc6854dfcd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:30.268907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c091d-9395-49d0-a997-bc6854dfcd95 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:30.269193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c091d-9395-49d0-a997-bc6854dfcd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:30.269486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c091d-9395-49d0-a997-bc6854dfcd95 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:30.270259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c091d-9395-49d0-a997-bc6854dfcd95 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:30.271652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c091d-9395-49d0-a997-bc6854dfcd95 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:30.279796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad730-660a-47b9-80f7-aa4ebe678c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:30.280602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad730-660a-47b9-80f7-aa4ebe678c58 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:30.280895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad730-660a-47b9-80f7-aa4ebe678c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:30.281181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad730-660a-47b9-80f7-aa4ebe678c58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:30.282962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad730-660a-47b9-80f7-aa4ebe678c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:30.284534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad730-660a-47b9-80f7-aa4ebe678c58 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:30.286206 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 24/44] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:30.291588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad730-660a-47b9-80f7-aa4ebe678c58 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:30.364650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 21/45] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 22 08:41:30 2022] POST /identity/v3/roles => generated 223 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:30.404655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad730-660a-47b9-80f7-aa4ebe678c58 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:30.409908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:30.446594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc5624-c63f-4963-9505-6a5b68cdb178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:30.447184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5624-c63f-4963-9505-6a5b68cdb178 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:30.447470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5624-c63f-4963-9505-6a5b68cdb178 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:30.447750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc5624-c63f-4963-9505-6a5b68cdb178 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:30.448560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc5624-c63f-4963-9505-6a5b68cdb178 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:30.450152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc5624-c63f-4963-9505-6a5b68cdb178 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:30.524975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 25/46] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:41:30 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:41:32.122694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c516d5-418a-4346-9fc5-6d0b9affc208 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.123177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c516d5-418a-4346-9fc5-6d0b9affc208 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.123177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c516d5-418a-4346-9fc5-6d0b9affc208 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.124535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 22/47] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:32.129865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7b3a-1723-4453-967a-6ad6b158e5ce None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.130309 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7b3a-1723-4453-967a-6ad6b158e5ce None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.130468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a7b3a-1723-4453-967a-6ad6b158e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.147795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-127a7b3a-1723-4453-967a-6ad6b158e5ce None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:32.148961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-127a7b3a-1723-4453-967a-6ad6b158e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:32.215241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:32.238543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c516d5-418a-4346-9fc5-6d0b9affc208 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:32.304955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:32.340576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c516d5-418a-4346-9fc5-6d0b9affc208 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:32.375004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1836b-d535-45bc-ad02-6f4c9cf4bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:32.375731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1836b-d535-45bc-ad02-6f4c9cf4bef6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.376691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1836b-d535-45bc-ad02-6f4c9cf4bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.377063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1836b-d535-45bc-ad02-6f4c9cf4bef6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.387232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1836b-d535-45bc-ad02-6f4c9cf4bef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-71c1836b-d535-45bc-ad02-6f4c9cf4bef6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:32.396103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:32.396924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:32.397871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 23/49] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:32.403094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a7b3a-1723-4453-967a-6ad6b158e5ce None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:32.484833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:32.499476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a7b3a-1723-4453-967a-6ad6b158e5ce None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:32.533702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da2559-91c4-4829-83b3-b872be0e67f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:32.534395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da2559-91c4-4829-83b3-b872be0e67f3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.534686 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da2559-91c4-4829-83b3-b872be0e67f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.534961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da2559-91c4-4829-83b3-b872be0e67f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.535715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da2559-91c4-4829-83b3-b872be0e67f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:32.536016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da2559-91c4-4829-83b3-b872be0e67f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:32.537423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da2559-91c4-4829-83b3-b872be0e67f3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:32.545712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 27/50] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:32.551836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1836b-d535-45bc-ad02-6f4c9cf4bef6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:32.580933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18612db5-0a44-4b81-8ddd-57aad143bff2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.581218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18612db5-0a44-4b81-8ddd-57aad143bff2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.581495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18612db5-0a44-4b81-8ddd-57aad143bff2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.582890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 28/51] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:32.587842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53bb96-a8cb-41e4-a608-c37abb88c24b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.588131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53bb96-a8cb-41e4-a608-c37abb88c24b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.588410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53bb96-a8cb-41e4-a608-c37abb88c24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.605087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4c53bb96-a8cb-41e4-a608-c37abb88c24b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:32.606394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4c53bb96-a8cb-41e4-a608-c37abb88c24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:32.654197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1836b-d535-45bc-ad02-6f4c9cf4bef6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:32.674770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 29/52] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:32.679768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:32.688184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4da56c-68bc-4dc7-9b8b-b10f90d5b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:32.689831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4da56c-68bc-4dc7-9b8b-b10f90d5b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.690153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4da56c-68bc-4dc7-9b8b-b10f90d5b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.690438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4da56c-68bc-4dc7-9b8b-b10f90d5b7e9 None admin] PATH_INFO: `/v3/users/4eee573b0bd94bdf970811c775ee4f22` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.691706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4da56c-68bc-4dc7-9b8b-b10f90d5b7e9 None admin] RBAC: Authorizing `identity:get_user(user_id=4eee573b0bd94bdf970811c775ee4f22)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:32.693154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4da56c-68bc-4dc7-9b8b-b10f90d5b7e9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:32.694824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 24/53] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:32 2022] GET /identity/v3/users/4eee573b0bd94bdf970811c775ee4f22 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:32.699663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53bb96-a8cb-41e4-a608-c37abb88c24b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:32.700002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4da56c-68bc-4dc7-9b8b-b10f90d5b7e9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:32.776232 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:32.797396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53bb96-a8cb-41e4-a608-c37abb88c24b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:32.802743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4da56c-68bc-4dc7-9b8b-b10f90d5b7e9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:32.833912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50a7f6-6020-43bd-9617-86d98b7b7ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:32.834857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50a7f6-6020-43bd-9617-86d98b7b7ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.835152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50a7f6-6020-43bd-9617-86d98b7b7ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.835420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50a7f6-6020-43bd-9617-86d98b7b7ab2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.837551 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50a7f6-6020-43bd-9617-86d98b7b7ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:32.839307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50a7f6-6020-43bd-9617-86d98b7b7ab2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:32.839914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde8471-22ca-4cba-b1dd-f43b8e4fb056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:32.840707 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8471-22ca-4cba-b1dd-f43b8e4fb056 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.840979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 30/54] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:32.841090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8471-22ca-4cba-b1dd-f43b8e4fb056 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.841256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8471-22ca-4cba-b1dd-f43b8e4fb056 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.842536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde8471-22ca-4cba-b1dd-f43b8e4fb056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:32.843957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde8471-22ca-4cba-b1dd-f43b8e4fb056 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:32.845982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 25/55] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:32.846570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50a7f6-6020-43bd-9617-86d98b7b7ab2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:32.851346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde8471-22ca-4cba-b1dd-f43b8e4fb056 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:32.911180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:32.947015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50a7f6-6020-43bd-9617-86d98b7b7ab2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:32.950294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde8471-22ca-4cba-b1dd-f43b8e4fb056 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:32.979252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a486e04-19e1-45e0-a905-ea8a017d41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:32.979968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486e04-19e1-45e0-a905-ea8a017d41d7 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.980194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486e04-19e1-45e0-a905-ea8a017d41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.980472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a486e04-19e1-45e0-a905-ea8a017d41d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.981176 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a486e04-19e1-45e0-a905-ea8a017d41d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:32.982651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a486e04-19e1-45e0-a905-ea8a017d41d7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:32.983163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c4d17-2d8c-486b-9fc1-925387bb74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:32.983812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4d17-2d8c-486b-9fc1-925387bb74f0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:32.984100 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4d17-2d8c-486b-9fc1-925387bb74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:32.984381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4d17-2d8c-486b-9fc1-925387bb74f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:32.985706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c4d17-2d8c-486b-9fc1-925387bb74f0 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.domain.id=default, user.id=4eee573b0bd94bdf970811c775ee4f22) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:32.986037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c4d17-2d8c-486b-9fc1-925387bb74f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:32.987484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c4d17-2d8c-486b-9fc1-925387bb74f0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:32.995618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 26/56] 10.222.0.36 () {56 vars in 1322 bytes} [Wed Jun 22 08:41:32 2022] GET /identity/v3/role_assignments?user.id=4eee573b0bd94bdf970811c775ee4f22&scope.domain.id=default&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:33.065712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:33.072555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 31/57] 10.222.0.36 () {60 vars in 1140 bytes} [Wed Jun 22 08:41:32 2022] POST /identity/v3/projects => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:41:35.125417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319a98-21a6-42f4-9f2c-07dbbb894aa1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:35.126519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319a98-21a6-42f4-9f2c-07dbbb894aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:35.126625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319a98-21a6-42f4-9f2c-07dbbb894aa1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:35.128301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 27/58] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:35.133514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f17706-4ff3-4a60-bcb6-b2a7d938d929 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:35.133883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f17706-4ff3-4a60-bcb6-b2a7d938d929 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:35.134099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f17706-4ff3-4a60-bcb6-b2a7d938d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:35.150497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-89f17706-4ff3-4a60-bcb6-b2a7d938d929 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:35.151682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-89f17706-4ff3-4a60-bcb6-b2a7d938d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:35.215182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 32/59] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:35.240065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319a98-21a6-42f4-9f2c-07dbbb894aa1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:35.447605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319a98-21a6-42f4-9f2c-07dbbb894aa1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:35.473053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:35.481308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4236c5e-7c9e-4ed6-9827-9f1a1872de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:35.482108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236c5e-7c9e-4ed6-9827-9f1a1872de1c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:35.482402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236c5e-7c9e-4ed6-9827-9f1a1872de1c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:35.482711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236c5e-7c9e-4ed6-9827-9f1a1872de1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:35.483891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4236c5e-7c9e-4ed6-9827-9f1a1872de1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:35.486142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4236c5e-7c9e-4ed6-9827-9f1a1872de1c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:35.495488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 28/60] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:35.495587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f17706-4ff3-4a60-bcb6-b2a7d938d929 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:35.592258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f17706-4ff3-4a60-bcb6-b2a7d938d929 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:35.622318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:35.629884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d89cf-016b-4cd8-b2f0-c805b35ee763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:35.630574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d89cf-016b-4cd8-b2f0-c805b35ee763 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:35.630865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d89cf-016b-4cd8-b2f0-c805b35ee763 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:35.631143 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d89cf-016b-4cd8-b2f0-c805b35ee763 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:35.631849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d89cf-016b-4cd8-b2f0-c805b35ee763 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:35.633281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d89cf-016b-4cd8-b2f0-c805b35ee763 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:35.715704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 33/61] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:41:35 2022] POST /identity/v3/users => generated 275 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:38.853945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762bd2-a3e4-4fc8-884b-517c6cd10847 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:38.854800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762bd2-a3e4-4fc8-884b-517c6cd10847 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:38.855251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762bd2-a3e4-4fc8-884b-517c6cd10847 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:38.856771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 29/62] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:38.862876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea685-dff2-4117-9d6d-3843cfe1ecc9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:38.863629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea685-dff2-4117-9d6d-3843cfe1ecc9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:38.864056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea685-dff2-4117-9d6d-3843cfe1ecc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:38.890252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-26fea685-dff2-4117-9d6d-3843cfe1ecc9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:38.892136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-26fea685-dff2-4117-9d6d-3843cfe1ecc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:38.928468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7903b-f834-40e3-9751-be87d87c3e36 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:38.929080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7903b-f834-40e3-9751-be87d87c3e36 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:38.929560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7903b-f834-40e3-9751-be87d87c3e36 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:38.931197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 30/63] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:38.936222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c3d4-d7b2-4e0d-9f13-5752905fef8b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:38.936750 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c3d4-d7b2-4e0d-9f13-5752905fef8b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:38.937227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10c3d4-d7b2-4e0d-9f13-5752905fef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:38.964680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7b10c3d4-d7b2-4e0d-9f13-5752905fef8b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:38.967552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7b10c3d4-d7b2-4e0d-9f13-5752905fef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:39.012589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 34/64] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:39.066990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fea685-dff2-4117-9d6d-3843cfe1ecc9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.078020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 31/65] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:39.101712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c3d4-d7b2-4e0d-9f13-5752905fef8b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.206343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10c3d4-d7b2-4e0d-9f13-5752905fef8b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.236685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:39.245065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fea685-dff2-4117-9d6d-3843cfe1ecc9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.249008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652c851-02e1-4c8a-94eb-94e5f24dbd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.250051 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652c851-02e1-4c8a-94eb-94e5f24dbd3d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.252940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652c851-02e1-4c8a-94eb-94e5f24dbd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.252940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652c851-02e1-4c8a-94eb-94e5f24dbd3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.261872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:39.264396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652c851-02e1-4c8a-94eb-94e5f24dbd3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3652c851-02e1-4c8a-94eb-94e5f24dbd3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:39.273592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:39.274509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:39.275279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:39.277682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 32/66] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:41:39.279281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb19e-d4b2-4b89-8ed6-3fe8677c70fe None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.279803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb19e-d4b2-4b89-8ed6-3fe8677c70fe None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.280282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdb19e-d4b2-4b89-8ed6-3fe8677c70fe None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.286389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 33/67] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:39.287706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695ce0-225b-4d16-8cdf-cc65aa894e12 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.288158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695ce0-225b-4d16-8cdf-cc65aa894e12 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.288158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1695ce0-225b-4d16-8cdf-cc65aa894e12 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.288748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9bee-bffb-4ede-ab8b-0659e8abd267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.289416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 34/68] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:39.289569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9bee-bffb-4ede-ab8b-0659e8abd267 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.289856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9bee-bffb-4ede-ab8b-0659e8abd267 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.290168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9bee-bffb-4ede-ab8b-0659e8abd267 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.290430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d34ec-0f86-4c89-9f56-95b80cce451c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.290721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d34ec-0f86-4c89-9f56-95b80cce451c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.291052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d34ec-0f86-4c89-9f56-95b80cce451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.302987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab9bee-bffb-4ede-ab8b-0659e8abd267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:39.308853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f84d34ec-0f86-4c89-9f56-95b80cce451c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:39.310048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f84d34ec-0f86-4c89-9f56-95b80cce451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-71ab9bee-bffb-4ede-ab8b-0659e8abd267 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:39.311923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:39.312760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:39.313682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:41:39.314431 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9bee-bffb-4ede-ab8b-0659e8abd267 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.388996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 35/70] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:39.390242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a072-3200-4254-9d47-04e3b5616cd5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.390711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a072-3200-4254-9d47-04e3b5616cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.390998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a072-3200-4254-9d47-04e3b5616cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.407779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-68c5a072-3200-4254-9d47-04e3b5616cd5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:39.409076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-68c5a072-3200-4254-9d47-04e3b5616cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:39.431017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9bee-bffb-4ede-ab8b-0659e8abd267 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.467558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.468698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.469250 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.470429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.471404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:39.472096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:39.473837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:39.477123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 36/71] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:39.477920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5a072-3200-4254-9d47-04e3b5616cd5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.488012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 36/72] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:39.488617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.529343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:39.541389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:39.597325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5a072-3200-4254-9d47-04e3b5616cd5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.608167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813d9a5-93e1-4796-b8e0-4d539affa14c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.631499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.632176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.632468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.632752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.633507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:39.633821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:39.635280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:39.648883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:39.649743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.657852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffd1db-9d4a-4345-be91-191c4f005675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.658687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd1db-9d4a-4345-be91-191c4f005675 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.658975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd1db-9d4a-4345-be91-191c4f005675 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.659256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd1db-9d4a-4345-be91-191c4f005675 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.669764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffd1db-9d4a-4345-be91-191c4f005675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6cffd1db-9d4a-4345-be91-191c4f005675 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:39.677689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:39.678678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:39.679430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 37/74] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:39.680043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffd1db-9d4a-4345-be91-191c4f005675 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.752652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b578df-ec46-40a5-9491-e2d626474f8f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.759729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:39.775150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:39.780976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffd1db-9d4a-4345-be91-191c4f005675 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.786858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8802bc-bbac-4374-a585-be5d734dca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.787730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8802bc-bbac-4374-a585-be5d734dca7c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.788012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8802bc-bbac-4374-a585-be5d734dca7c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.788289 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8802bc-bbac-4374-a585-be5d734dca7c None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.803035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8802bc-bbac-4374-a585-be5d734dca7c None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:39.804588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8802bc-bbac-4374-a585-be5d734dca7c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:39.806284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:39.807499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf7ffb-a626-4491-815c-ecf7de636da7 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.807833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf7ffb-a626-4491-815c-ecf7de636da7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.808062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf7ffb-a626-4491-815c-ecf7de636da7 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.809544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 39/76] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:39.810266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf7ffb-a626-4491-815c-ecf7de636da7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.825814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e20b-ec6e-441c-81d9-f6ce8055f3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.826651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e20b-ec6e-441c-81d9-f6ce8055f3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.826935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e20b-ec6e-441c-81d9-f6ce8055f3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.827214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e20b-ec6e-441c-81d9-f6ce8055f3d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.838140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865e20b-ec6e-441c-81d9-f6ce8055f3d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4865e20b-ec6e-441c-81d9-f6ce8055f3d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:39.845828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:39.846709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 38/77] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:39.848156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e20b-ec6e-441c-81d9-f6ce8055f3d7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.924119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf7ffb-a626-4491-815c-ecf7de636da7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.950791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e20b-ec6e-441c-81d9-f6ce8055f3d7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:39.957600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319389a-fa67-4a56-a018-d558911ac2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.958853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319389a-fa67-4a56-a018-d558911ac2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.959289 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319389a-fa67-4a56-a018-d558911ac2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.959683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319389a-fa67-4a56-a018-d558911ac2a2 None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.961125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319389a-fa67-4a56-a018-d558911ac2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:39.962575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319389a-fa67-4a56-a018-d558911ac2a2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:39.964201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 40/78] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:39.964963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319389a-fa67-4a56-a018-d558911ac2a2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:39.986974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f9395-d094-41a6-bb98-f2836a17c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:39.987864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f9395-d094-41a6-bb98-f2836a17c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:39.988156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f9395-d094-41a6-bb98-f2836a17c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:39.988439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f9395-d094-41a6-bb98-f2836a17c5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:39.989201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f9395-d094-41a6-bb98-f2836a17c5a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:39.989517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f9395-d094-41a6-bb98-f2836a17c5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:39.990929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f9395-d094-41a6-bb98-f2836a17c5a1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:39.996425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:39.998925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 39/79] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:40.000112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cc1a4-5dad-4164-9444-567cd6645335 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.000400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cc1a4-5dad-4164-9444-567cd6645335 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.001252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cc1a4-5dad-4164-9444-567cd6645335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.018181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f65cc1a4-5dad-4164-9444-567cd6645335 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:40.019361 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f65cc1a4-5dad-4164-9444-567cd6645335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:40.036049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.072377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319389a-fa67-4a56-a018-d558911ac2a2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.089902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 40/80] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:40.090782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cc1a4-5dad-4164-9444-567cd6645335 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.108540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dd3f6-a2f7-4521-915b-e9c848f73f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.109760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dd3f6-a2f7-4521-915b-e9c848f73f36 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.110270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dd3f6-a2f7-4521-915b-e9c848f73f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.110721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dd3f6-a2f7-4521-915b-e9c848f73f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.180471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dd3f6-a2f7-4521-915b-e9c848f73f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.181870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dd3f6-a2f7-4521-915b-e9c848f73f36 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.189959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cc1a4-5dad-4164-9444-567cd6645335 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.211916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.224508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.225178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.225466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.233170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.233170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:40.233170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.233170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.237021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 41/81] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:40.237844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.250250 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.284914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:40.359806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dd3f6-a2f7-4521-915b-e9c848f73f36 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.360550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491d040-01fb-411b-9b6a-4834221b73ce None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.379200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c062403-8392-4a9a-a9e7-f5bc6a0d6dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.379834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062403-8392-4a9a-a9e7-f5bc6a0d6dfe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.380129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062403-8392-4a9a-a9e7-f5bc6a0d6dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.380412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c062403-8392-4a9a-a9e7-f5bc6a0d6dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.390238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dd3f6-a2f7-4521-915b-e9c848f73f36 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.418598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.424253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9d04e-bc9a-4e9e-81d2-ca2acf060305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.425120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d04e-bc9a-4e9e-81d2-ca2acf060305 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.425408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d04e-bc9a-4e9e-81d2-ca2acf060305 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.425691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d04e-bc9a-4e9e-81d2-ca2acf060305 None admin] PATH_INFO: `/v3/users/4eee573b0bd94bdf970811c775ee4f22` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.426922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9d04e-bc9a-4e9e-81d2-ca2acf060305 None admin] RBAC: Authorizing `identity:get_user(user_id=4eee573b0bd94bdf970811c775ee4f22)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.428359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9d04e-bc9a-4e9e-81d2-ca2acf060305 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.430195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 42/83] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/users/4eee573b0bd94bdf970811c775ee4f22 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:40.430825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9d04e-bc9a-4e9e-81d2-ca2acf060305 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.451541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c062403-8392-4a9a-a9e7-f5bc6a0d6dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.452981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c062403-8392-4a9a-a9e7-f5bc6a0d6dfe None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.464818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.528524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9d04e-bc9a-4e9e-81d2-ca2acf060305 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.553235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 42/84] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:40.554084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c062403-8392-4a9a-a9e7-f5bc6a0d6dfe None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.561752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881e879-b283-482e-9766-841073a99681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.562568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e879-b283-482e-9766-841073a99681 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.562855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e879-b283-482e-9766-841073a99681 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.563264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e879-b283-482e-9766-841073a99681 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.564499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881e879-b283-482e-9766-841073a99681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.565923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881e879-b283-482e-9766-841073a99681 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.567571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 43/85] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:40.568331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881e879-b283-482e-9766-841073a99681 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.635681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.652952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c062403-8392-4a9a-a9e7-f5bc6a0d6dfe None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.664409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.669092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881e879-b283-482e-9766-841073a99681 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.687499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b965-d663-47af-be99-7e74ef4cf4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.688334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b965-d663-47af-be99-7e74ef4cf4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.688618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b965-d663-47af-be99-7e74ef4cf4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.688900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b965-d663-47af-be99-7e74ef4cf4b3 None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.690106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12b965-d663-47af-be99-7e74ef4cf4b3 None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.691684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12b965-d663-47af-be99-7e74ef4cf4b3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.693213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 43/86] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:40.693972 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b965-d663-47af-be99-7e74ef4cf4b3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.703137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c985-f346-491e-8dec-80f41eb3918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.704067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c985-f346-491e-8dec-80f41eb3918b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.704353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c985-f346-491e-8dec-80f41eb3918b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.704643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c985-f346-491e-8dec-80f41eb3918b None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.705850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7c985-f346-491e-8dec-80f41eb3918b None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.707320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7c985-f346-491e-8dec-80f41eb3918b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.709047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 44/87] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:40.714419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c985-f346-491e-8dec-80f41eb3918b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.791732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b965-d663-47af-be99-7e74ef4cf4b3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.815989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c985-f346-491e-8dec-80f41eb3918b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.824960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7993c-e4a7-471f-bb6a-ebdc39f68b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.825606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7993c-e4a7-471f-bb6a-ebdc39f68b6a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.825890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7993c-e4a7-471f-bb6a-ebdc39f68b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.826196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7993c-e4a7-471f-bb6a-ebdc39f68b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.851066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3edc-bf7a-4ea7-93a5-c06ced2b5943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.851933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3edc-bf7a-4ea7-93a5-c06ced2b5943 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.852226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3edc-bf7a-4ea7-93a5-c06ced2b5943 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.852506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3edc-bf7a-4ea7-93a5-c06ced2b5943 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.853703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e3edc-bf7a-4ea7-93a5-c06ced2b5943 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.855158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e3edc-bf7a-4ea7-93a5-c06ced2b5943 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.856861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 45/88] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:40.857605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3edc-bf7a-4ea7-93a5-c06ced2b5943 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:40.864772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.876058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:40.897905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7993c-e4a7-471f-bb6a-ebdc39f68b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.899530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7993c-e4a7-471f-bb6a-ebdc39f68b6a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.961264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3edc-bf7a-4ea7-93a5-c06ced2b5943 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:40.994569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e45d-fd40-43a9-a79a-fc72c6c2c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:40.995233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e45d-fd40-43a9-a79a-fc72c6c2c8b6 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:40.995518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e45d-fd40-43a9-a79a-fc72c6c2c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:40.995803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e45d-fd40-43a9-a79a-fc72c6c2c8b6 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:40.996518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1e45d-fd40-43a9-a79a-fc72c6c2c8b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:40.997932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1e45d-fd40-43a9-a79a-fc72c6c2c8b6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:40.998267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 44/89] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:40.999106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7993c-e4a7-471f-bb6a-ebdc39f68b6a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:41.075909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 46/90] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:41:40 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:41.075909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e45d-fd40-43a9-a79a-fc72c6c2c8b6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:41.094472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:41.100352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7993c-e4a7-471f-bb6a-ebdc39f68b6a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:41.141567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76353792-2498-4df3-8ef1-3d7051c34f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:41.142415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353792-2498-4df3-8ef1-3d7051c34f41 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:41.142749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353792-2498-4df3-8ef1-3d7051c34f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:41.143028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76353792-2498-4df3-8ef1-3d7051c34f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:41.148898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:41.198242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e45d-fd40-43a9-a79a-fc72c6c2c8b6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:41.219627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76353792-2498-4df3-8ef1-3d7051c34f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:41.221021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76353792-2498-4df3-8ef1-3d7051c34f41 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:41.241794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:41.242747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:41.243242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:41.244345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:41.244345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] RBAC: Adding query filter params (role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=90903642dfe940ce8410308d77d923ff, user.id=777ddb4ee44846a8a21b1b6089e99c6a) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:41.244678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:41.246733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:41.253608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 47/91] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:41 2022] GET /identity/v3/role_assignments?user.id=777ddb4ee44846a8a21b1b6089e99c6a&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:41.254276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:41.333070 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:41.361440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 45/92] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:41.362563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76353792-2498-4df3-8ef1-3d7051c34f41 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:41.409782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a39ae9-db01-4e84-8f17-4dd9f37e98f9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:41.448107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:41.460593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:41.468159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:41.468159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:41.468159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:41.468159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] RBAC: Adding query filter params (role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=90903642dfe940ce8410308d77d923ff, user.id=777ddb4ee44846a8a21b1b6089e99c6a) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:41.468159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:41.468159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:41.471832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 48/93] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:41 2022] GET /identity/v3/role_assignments?user.id=777ddb4ee44846a8a21b1b6089e99c6a&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:41.472639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:41.503995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76353792-2498-4df3-8ef1-3d7051c34f41 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:41.545526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e32a2-4c63-4c27-a6aa-b0620fb5959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:41.554187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e32a2-4c63-4c27-a6aa-b0620fb5959c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:41.554187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e32a2-4c63-4c27-a6aa-b0620fb5959c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:41.554187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e32a2-4c63-4c27-a6aa-b0620fb5959c None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:41.554187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e32a2-4c63-4c27-a6aa-b0620fb5959c None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:41.554187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e32a2-4c63-4c27-a6aa-b0620fb5959c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:41.554187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 46/94] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:41 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:41.559983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e32a2-4c63-4c27-a6aa-b0620fb5959c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:41.650449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:41.693375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41ce5b-8a8c-4698-bc42-5f31ae1fb823 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:41.750715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e32a2-4c63-4c27-a6aa-b0620fb5959c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:41.790817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4244b-05ca-4d9f-8bdc-a8a43c804818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:41.791701 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4244b-05ca-4d9f-8bdc-a8a43c804818 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:41.791985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4244b-05ca-4d9f-8bdc-a8a43c804818 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:41.792261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4244b-05ca-4d9f-8bdc-a8a43c804818 None admin] PATH_INFO: `/v3/projects/6f4cfd3291dc476fbcb8ee8cce2d4285` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:41.793499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4244b-05ca-4d9f-8bdc-a8a43c804818 None admin] RBAC: Authorizing `identity:get_project(project_id=6f4cfd3291dc476fbcb8ee8cce2d4285)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:41.794958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4244b-05ca-4d9f-8bdc-a8a43c804818 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:41.796661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 49/95] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:41 2022] GET /identity/v3/projects/6f4cfd3291dc476fbcb8ee8cce2d4285 => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:41.803419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4244b-05ca-4d9f-8bdc-a8a43c804818 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:41.823040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24938924-61b9-47a2-bc6f-0d3c52436b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:41.823785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938924-61b9-47a2-bc6f-0d3c52436b03 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:41.824024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938924-61b9-47a2-bc6f-0d3c52436b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:41.824311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24938924-61b9-47a2-bc6f-0d3c52436b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:41.825235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24938924-61b9-47a2-bc6f-0d3c52436b03 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=90903642dfe940ce8410308d77d923ff, user.id=4eee573b0bd94bdf970811c775ee4f22) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:41.825559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24938924-61b9-47a2-bc6f-0d3c52436b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:41.827067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24938924-61b9-47a2-bc6f-0d3c52436b03 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:41.848296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 47/96] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:41 2022] GET /identity/v3/role_assignments?user.id=4eee573b0bd94bdf970811c775ee4f22&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:41.908553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:41.972513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4244b-05ca-4d9f-8bdc-a8a43c804818 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:42.025440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd3bf7-7e24-4513-b4dd-6e235730bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:42.026051 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd3bf7-7e24-4513-b4dd-6e235730bb18 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:42.026363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd3bf7-7e24-4513-b4dd-6e235730bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:42.026707 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd3bf7-7e24-4513-b4dd-6e235730bb18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:42.027618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd3bf7-7e24-4513-b4dd-6e235730bb18 None admin] RBAC: Adding query filter params (role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=6f4cfd3291dc476fbcb8ee8cce2d4285, user.id=777ddb4ee44846a8a21b1b6089e99c6a) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:42.027951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd3bf7-7e24-4513-b4dd-6e235730bb18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:42.029462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd3bf7-7e24-4513-b4dd-6e235730bb18 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:42.038466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 50/97] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:41 2022] GET /identity/v3/role_assignments?user.id=777ddb4ee44846a8a21b1b6089e99c6a&scope.project.id=6f4cfd3291dc476fbcb8ee8cce2d4285&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:44.213924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981a17b-df01-4dfc-aef6-ccd443e74e5f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.214603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981a17b-df01-4dfc-aef6-ccd443e74e5f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.214603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981a17b-df01-4dfc-aef6-ccd443e74e5f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.215967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 48/98] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:44.220830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7535d94-26b6-48c6-ba4a-97b37a4e860b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.221341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7535d94-26b6-48c6-ba4a-97b37a4e860b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.221490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7535d94-26b6-48c6-ba4a-97b37a4e860b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.222917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 51/99] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:44.224049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65e1fe-39d6-4847-8b1a-debeaa437733 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.224342 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65e1fe-39d6-4847-8b1a-debeaa437733 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.224624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65e1fe-39d6-4847-8b1a-debeaa437733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.231526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44c84b-f512-4937-a5d6-72781a596c2f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.231820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44c84b-f512-4937-a5d6-72781a596c2f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.232105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44c84b-f512-4937-a5d6-72781a596c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.255179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9d44c84b-f512-4937-a5d6-72781a596c2f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:44.256398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9d44c84b-f512-4937-a5d6-72781a596c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:44.259058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0e65e1fe-39d6-4847-8b1a-debeaa437733 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:44.260252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0e65e1fe-39d6-4847-8b1a-debeaa437733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:44.359602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 52/100] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:44.399058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b418-74ea-487e-893d-79a5a24d858d None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.399463 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b418-74ea-487e-893d-79a5a24d858d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.399746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b418-74ea-487e-893d-79a5a24d858d None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.400614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 49/101] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:44.401176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 53/102] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:41:44.405112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65e1fe-39d6-4847-8b1a-debeaa437733 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:44.406265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4eb6b-5b5c-4462-a237-1d8bad7d609a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.406557 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4eb6b-5b5c-4462-a237-1d8bad7d609a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.407447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4eb6b-5b5c-4462-a237-1d8bad7d609a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.435429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-05d4eb6b-5b5c-4462-a237-1d8bad7d609a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:44.436693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-05d4eb6b-5b5c-4462-a237-1d8bad7d609a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:44.514084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:44.550090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:44.591740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 54/103] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:44.595002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4eb6b-5b5c-4462-a237-1d8bad7d609a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:44.624035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65e1fe-39d6-4847-8b1a-debeaa437733 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:44.692685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084428f3-8e4b-439d-99b7-4161bd6f40ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:44.693488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084428f3-8e4b-439d-99b7-4161bd6f40ec None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.693774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084428f3-8e4b-439d-99b7-4161bd6f40ec None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.694052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084428f3-8e4b-439d-99b7-4161bd6f40ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.700454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084428f3-8e4b-439d-99b7-4161bd6f40ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:44.701900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084428f3-8e4b-439d-99b7-4161bd6f40ec None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:44.704164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 50/104] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:44.710368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084428f3-8e4b-439d-99b7-4161bd6f40ec None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:44.793597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4eb6b-5b5c-4462-a237-1d8bad7d609a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:44.860136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f4c57-177e-4ff5-bf3c-8d94f353403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:44.861354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4c57-177e-4ff5-bf3c-8d94f353403a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.861647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4c57-177e-4ff5-bf3c-8d94f353403a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.861927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f4c57-177e-4ff5-bf3c-8d94f353403a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.882048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f4c57-177e-4ff5-bf3c-8d94f353403a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-886f4c57-177e-4ff5-bf3c-8d94f353403a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:44.891527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:44.892522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:44.893298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:44.895605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 55/105] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:41:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:44.896603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f4c57-177e-4ff5-bf3c-8d94f353403a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:44.899252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084428f3-8e4b-439d-99b7-4161bd6f40ec None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:44.910331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:44.936142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0596-d474-4a8e-b40b-29136edadc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:44.937064 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0596-d474-4a8e-b40b-29136edadc79 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.937411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0596-d474-4a8e-b40b-29136edadc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.938572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0596-d474-4a8e-b40b-29136edadc79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.943434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:44.951276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd0596-d474-4a8e-b40b-29136edadc79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-08fd0596-d474-4a8e-b40b-29136edadc79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:44.959707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:44.960804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:44.961741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:44.962921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 51/106] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:44.964532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a0ecb-86a1-4bed-ab08-29e2b199df54 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.964826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a0ecb-86a1-4bed-ab08-29e2b199df54 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.965105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a0ecb-86a1-4bed-ab08-29e2b199df54 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.966846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 52/107] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:44.968158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f5657-3c29-4eeb-9434-314a383edadb None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:44.968448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f5657-3c29-4eeb-9434-314a383edadb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:44.968727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f5657-3c29-4eeb-9434-314a383edadb None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:44.974498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 53/108] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:44.974498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f5657-3c29-4eeb-9434-314a383edadb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.027523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f4c57-177e-4ff5-bf3c-8d94f353403a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.067756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8598be-0dac-4bab-ae4f-7861fcebc0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.068347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8598be-0dac-4bab-ae4f-7861fcebc0f4 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.068632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8598be-0dac-4bab-ae4f-7861fcebc0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.068912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8598be-0dac-4bab-ae4f-7861fcebc0f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.069678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8598be-0dac-4bab-ae4f-7861fcebc0f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:45.071221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8598be-0dac-4bab-ae4f-7861fcebc0f4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:45.115910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f5657-3c29-4eeb-9434-314a383edadb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.148886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 56/109] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:41:44 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:45.149740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8598be-0dac-4bab-ae4f-7861fcebc0f4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.164542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cbb5f-7061-4649-9097-cbcbc81932b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.165645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cbb5f-7061-4649-9097-cbcbc81932b2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.166123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cbb5f-7061-4649-9097-cbcbc81932b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.166540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cbb5f-7061-4649-9097-cbcbc81932b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.167809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cbb5f-7061-4649-9097-cbcbc81932b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:45.168299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cbb5f-7061-4649-9097-cbcbc81932b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:45.170132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cbb5f-7061-4649-9097-cbcbc81932b2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:45.181093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 54/110] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:41:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:45.182911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580689-22a0-466f-bf98-0431a677201c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.183380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580689-22a0-466f-bf98-0431a677201c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.183797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580689-22a0-466f-bf98-0431a677201c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.209628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3e580689-22a0-466f-bf98-0431a677201c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:45.211272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3e580689-22a0-466f-bf98-0431a677201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:45.237927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:45.268571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:45.279910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8598be-0dac-4bab-ae4f-7861fcebc0f4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.286956 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 55/111] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:45.288080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10e31-109c-4e87-a627-73370361ddd4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.288373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10e31-109c-4e87-a627-73370361ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.289009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10e31-109c-4e87-a627-73370361ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.308212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bfe10e31-109c-4e87-a627-73370361ddd4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:45.309426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bfe10e31-109c-4e87-a627-73370361ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:45.332224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.332831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.333234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.333507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.334295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:45.334663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:45.336034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:45.345627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 57/112] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:45.350917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.388651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 56/113] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:45.390091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af784-db5c-4272-9aee-acedf4ff51f2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.390566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af784-db5c-4272-9aee-acedf4ff51f2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.390849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af784-db5c-4272-9aee-acedf4ff51f2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.392455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 57/114] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:45.393159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553af784-db5c-4272-9aee-acedf4ff51f2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.467399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4da4-84ab-4a8d-83d7-a2d893ea8613 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.493410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:45.504141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553af784-db5c-4272-9aee-acedf4ff51f2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.508181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdd806-f5d7-451e-9ac5-d1a4c67aea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.509264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdd806-f5d7-451e-9ac5-d1a4c67aea09 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.509733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdd806-f5d7-451e-9ac5-d1a4c67aea09 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.510173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdd806-f5d7-451e-9ac5-d1a4c67aea09 None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.511574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdd806-f5d7-451e-9ac5-d1a4c67aea09 None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:45.513188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdd806-f5d7-451e-9ac5-d1a4c67aea09 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:45.515094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 58/115] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:45 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:45.516288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdd806-f5d7-451e-9ac5-d1a4c67aea09 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.544033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03dfca-f099-4414-ac76-c9874e3a35a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.544236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:45.545164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03dfca-f099-4414-ac76-c9874e3a35a8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.545626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03dfca-f099-4414-ac76-c9874e3a35a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.545906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03dfca-f099-4414-ac76-c9874e3a35a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.556923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03dfca-f099-4414-ac76-c9874e3a35a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0f03dfca-f099-4414-ac76-c9874e3a35a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:45.565175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:45.566101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 58/116] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:45.571838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256dc4-03be-45e3-a0c1-e71404af25f8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.572563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256dc4-03be-45e3-a0c1-e71404af25f8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.572563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a256dc4-03be-45e3-a0c1-e71404af25f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.584789 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0a256dc4-03be-45e3-a0c1-e71404af25f8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:45.585918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0a256dc4-03be-45e3-a0c1-e71404af25f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:45.635195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdd806-f5d7-451e-9ac5-d1a4c67aea09 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.670083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 59/117] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:45.670083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256dc4-03be-45e3-a0c1-e71404af25f8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.683347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2b618-b0a8-491c-9a23-583ef8ca2710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.684230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b618-b0a8-491c-9a23-583ef8ca2710 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.684513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b618-b0a8-491c-9a23-583ef8ca2710 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.684792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2b618-b0a8-491c-9a23-583ef8ca2710 None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.686003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2b618-b0a8-491c-9a23-583ef8ca2710 None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:45.687588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2b618-b0a8-491c-9a23-583ef8ca2710 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:45.689758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 59/118] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:45 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:45.690447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2b618-b0a8-491c-9a23-583ef8ca2710 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.756432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:45.776809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a256dc4-03be-45e3-a0c1-e71404af25f8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.789161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:45.799555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2b618-b0a8-491c-9a23-583ef8ca2710 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.812051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024151-7d37-4dee-a8b2-e9a3d652b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.813368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024151-7d37-4dee-a8b2-e9a3d652b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.820003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024151-7d37-4dee-a8b2-e9a3d652b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.820003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024151-7d37-4dee-a8b2-e9a3d652b5a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.829825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10024151-7d37-4dee-a8b2-e9a3d652b5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:45.835125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5881ee-08be-4726-8136-b7eaed9f8e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.836188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5881ee-08be-4726-8136-b7eaed9f8e08 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.836483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5881ee-08be-4726-8136-b7eaed9f8e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.836766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5881ee-08be-4726-8136-b7eaed9f8e08 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.838000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5881ee-08be-4726-8136-b7eaed9f8e08 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:45.839555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5881ee-08be-4726-8136-b7eaed9f8e08 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-10024151-7d37-4dee-a8b2-e9a3d652b5a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:45.840882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:45.841688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:41:45.842537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:45.843177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 60/119] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:45 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:45.843257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 60/120] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:45.843257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024151-7d37-4dee-a8b2-e9a3d652b5a2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.847033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5881ee-08be-4726-8136-b7eaed9f8e08 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:45.955915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024151-7d37-4dee-a8b2-e9a3d652b5a2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.958866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5881ee-08be-4726-8136-b7eaed9f8e08 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:45.992522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2524-fc7f-4e48-8ad7-6a195b7a0796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.993422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2524-fc7f-4e48-8ad7-6a195b7a0796 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.993722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2524-fc7f-4e48-8ad7-6a195b7a0796 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.993999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d2524-fc7f-4e48-8ad7-6a195b7a0796 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.994184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:45.994697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:45.994990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:45.995267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:45.996014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:45.996319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:45.997685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.004037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:46.007126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d2524-fc7f-4e48-8ad7-6a195b7a0796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:46.008370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 61/121] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:46.013418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-125d2524-fc7f-4e48-8ad7-6a195b7a0796 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:46.015011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:46.016760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:46.017520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 61/122] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:41:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:46.018925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2524-fc7f-4e48-8ad7-6a195b7a0796 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.042412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:46.126792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d2524-fc7f-4e48-8ad7-6a195b7a0796 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.130765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255e10e-e789-483b-99c9-1337928544a8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.162251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc30b0c-4624-474e-b5a8-17737ca78d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:46.163455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30b0c-4624-474e-b5a8-17737ca78d12 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:46.163698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30b0c-4624-474e-b5a8-17737ca78d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:46.163975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc30b0c-4624-474e-b5a8-17737ca78d12 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff/users/777ddb4ee44846a8a21b1b6089e99c6a/roles/23dcaf1f585d4a03a6101a69a6bdd9f1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:46.166272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc30b0c-4624-474e-b5a8-17737ca78d12 None admin] RBAC: Authorizing `identity:create_grant(project_id=90903642dfe940ce8410308d77d923ff, user_id=777ddb4ee44846a8a21b1b6089e99c6a, role_id=23dcaf1f585d4a03a6101a69a6bdd9f1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:46.166415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb039d16-1cfa-472d-a975-36cb86178f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:46.167186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb039d16-1cfa-472d-a975-36cb86178f0c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:46.167475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb039d16-1cfa-472d-a975-36cb86178f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:46.167729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc30b0c-4624-474e-b5a8-17737ca78d12 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.167824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb039d16-1cfa-472d-a975-36cb86178f0c None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:46.168942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb039d16-1cfa-472d-a975-36cb86178f0c None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:46.170680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb039d16-1cfa-472d-a975-36cb86178f0c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.173765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:46 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:46.174487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb039d16-1cfa-472d-a975-36cb86178f0c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.229510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 62/124] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:41:46 2022] PUT /identity/v3/projects/90903642dfe940ce8410308d77d923ff/users/777ddb4ee44846a8a21b1b6089e99c6a/roles/23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:41:46.237701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc30b0c-4624-474e-b5a8-17737ca78d12 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.278432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:46.288438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb039d16-1cfa-472d-a975-36cb86178f0c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.324288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:46.347195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:46.347936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:46.348266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:46.348506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:46.349937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:46.350288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:46.352111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.365234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:46.365234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.395107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc30b0c-4624-474e-b5a8-17737ca78d12 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.441851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0c68d-ea51-41ed-9e78-1166440f3e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:46.442868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0c68d-ea51-41ed-9e78-1166440f3e10 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:46.443157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0c68d-ea51-41ed-9e78-1166440f3e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:46.443443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0c68d-ea51-41ed-9e78-1166440f3e10 None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:46.444638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0c68d-ea51-41ed-9e78-1166440f3e10 None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:46.446810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0c68d-ea51-41ed-9e78-1166440f3e10 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.448272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 63/126] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:46 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:46.448989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0c68d-ea51-41ed-9e78-1166440f3e10 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.492942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c943b6-a00e-43cb-8e1c-04e8fe03b84f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.538143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:46.539664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:46.540153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:46.540875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:46.541951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:46.542454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:46.544284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.556724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 64/127] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:46.558456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.564942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0c68d-ea51-41ed-9e78-1166440f3e10 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.576091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:46.600407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:46.608857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037bc0-2610-4e7b-8873-d3ec22c0bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:46.611088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037bc0-2610-4e7b-8873-d3ec22c0bda8 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:46.611858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037bc0-2610-4e7b-8873-d3ec22c0bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:46.612559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a037bc0-2610-4e7b-8873-d3ec22c0bda8 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff/users/777ddb4ee44846a8a21b1b6089e99c6a/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:46.615518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037bc0-2610-4e7b-8873-d3ec22c0bda8 None admin] RBAC: Authorizing `identity:create_grant(project_id=90903642dfe940ce8410308d77d923ff, user_id=777ddb4ee44846a8a21b1b6089e99c6a, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:46.617187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a037bc0-2610-4e7b-8873-d3ec22c0bda8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.677432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809942-a0aa-4f21-8bd1-2848d2a6ee67 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.697014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 64/128] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:41:46 2022] PUT /identity/v3/projects/90903642dfe940ce8410308d77d923ff/users/777ddb4ee44846a8a21b1b6089e99c6a/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:41:46.702723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037bc0-2610-4e7b-8873-d3ec22c0bda8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.732503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f64369-b293-4f02-8fe2-cdfbd5fd7e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:46.733754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f64369-b293-4f02-8fe2-cdfbd5fd7e71 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:46.734798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f64369-b293-4f02-8fe2-cdfbd5fd7e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:46.736817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f64369-b293-4f02-8fe2-cdfbd5fd7e71 None admin] PATH_INFO: `/v3/users/fc21b5a14ab440a0a6ff06d7671f6c38` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:46.765084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f64369-b293-4f02-8fe2-cdfbd5fd7e71 None admin] RBAC: Authorizing `identity:get_user(user_id=fc21b5a14ab440a0a6ff06d7671f6c38)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:46.768815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f64369-b293-4f02-8fe2-cdfbd5fd7e71 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.771777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 65/129] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:46 2022] GET /identity/v3/users/fc21b5a14ab440a0a6ff06d7671f6c38 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:46.773654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f64369-b293-4f02-8fe2-cdfbd5fd7e71 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:46.911505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a037bc0-2610-4e7b-8873-d3ec22c0bda8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.920577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:46.962549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f64369-b293-4f02-8fe2-cdfbd5fd7e71 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:46.963024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be7ae-32f0-403b-86a4-d69bf0eb5c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:46.963905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be7ae-32f0-403b-86a4-d69bf0eb5c71 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:46.964193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be7ae-32f0-403b-86a4-d69bf0eb5c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:46.964470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be7ae-32f0-403b-86a4-d69bf0eb5c71 None admin] PATH_INFO: `/v3/projects/6f4cfd3291dc476fbcb8ee8cce2d4285` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:46.965954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1be7ae-32f0-403b-86a4-d69bf0eb5c71 None admin] RBAC: Authorizing `identity:get_project(project_id=6f4cfd3291dc476fbcb8ee8cce2d4285)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:46.968363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1be7ae-32f0-403b-86a4-d69bf0eb5c71 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:46.970953 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 65/130] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:46 2022] GET /identity/v3/projects/6f4cfd3291dc476fbcb8ee8cce2d4285 => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:46.971758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be7ae-32f0-403b-86a4-d69bf0eb5c71 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:47.012476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd3bbf-0ec6-407d-bec7-7804f36dde78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:47.013682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3bbf-0ec6-407d-bec7-7804f36dde78 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.014234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3bbf-0ec6-407d-bec7-7804f36dde78 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.014738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3bbf-0ec6-407d-bec7-7804f36dde78 None admin] PATH_INFO: `/v3/users/4eee573b0bd94bdf970811c775ee4f22` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.017272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd3bbf-0ec6-407d-bec7-7804f36dde78 None admin] RBAC: Authorizing `identity:get_user(user_id=4eee573b0bd94bdf970811c775ee4f22)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:47.019003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd3bbf-0ec6-407d-bec7-7804f36dde78 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:47.021942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 66/131] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:46 2022] GET /identity/v3/users/4eee573b0bd94bdf970811c775ee4f22 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:47.022975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd3bbf-0ec6-407d-bec7-7804f36dde78 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:47.054503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:47.138652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be7ae-32f0-403b-86a4-d69bf0eb5c71 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:47.203703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd3bbf-0ec6-407d-bec7-7804f36dde78 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:47.205900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a501d11-5e1f-4e5b-aec0-a2a176bf452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:47.206738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a501d11-5e1f-4e5b-aec0-a2a176bf452d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.207031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a501d11-5e1f-4e5b-aec0-a2a176bf452d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.207320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a501d11-5e1f-4e5b-aec0-a2a176bf452d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.273905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddae59d-c6d0-4284-b7f7-569f26d10c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:47.274836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddae59d-c6d0-4284-b7f7-569f26d10c9a None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.275131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddae59d-c6d0-4284-b7f7-569f26d10c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.275410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddae59d-c6d0-4284-b7f7-569f26d10c9a None admin] PATH_INFO: `/v3/projects/6f4cfd3291dc476fbcb8ee8cce2d4285/users/777ddb4ee44846a8a21b1b6089e99c6a/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.279028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddae59d-c6d0-4284-b7f7-569f26d10c9a None admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cfd3291dc476fbcb8ee8cce2d4285, user_id=777ddb4ee44846a8a21b1b6089e99c6a, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:47.280603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddae59d-c6d0-4284-b7f7-569f26d10c9a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:47.313591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a501d11-5e1f-4e5b-aec0-a2a176bf452d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:47.315330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a501d11-5e1f-4e5b-aec0-a2a176bf452d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:47.357489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:47.363146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 67/132] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:41:47 2022] PUT /identity/v3/projects/6f4cfd3291dc476fbcb8ee8cce2d4285/users/777ddb4ee44846a8a21b1b6089e99c6a/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:41:47.363983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddae59d-c6d0-4284-b7f7-569f26d10c9a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:47.381492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:47.440284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 66/133] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:47.442006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b163-4bd1-42e2-bb6f-72ca9e679174 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.442540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b163-4bd1-42e2-bb6f-72ca9e679174 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.443013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404b163-4bd1-42e2-bb6f-72ca9e679174 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.445847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 67/134] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:47.446824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404b163-4bd1-42e2-bb6f-72ca9e679174 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:47.534190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddae59d-c6d0-4284-b7f7-569f26d10c9a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:47.578412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ea685-5323-48d1-8b6b-d76026c5d18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:47.579304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ea685-5323-48d1-8b6b-d76026c5d18b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.579597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ea685-5323-48d1-8b6b-d76026c5d18b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.579882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ea685-5323-48d1-8b6b-d76026c5d18b None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.581566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ea685-5323-48d1-8b6b-d76026c5d18b None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:47.582885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ea685-5323-48d1-8b6b-d76026c5d18b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:47.585128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 68/135] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:47 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:47.586439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf437-94cf-4a4e-9550-72fbb2f8c637 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.586733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf437-94cf-4a4e-9550-72fbb2f8c637 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.587351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cf437-94cf-4a4e-9550-72fbb2f8c637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.605436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b71cf437-94cf-4a4e-9550-72fbb2f8c637 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:47.606878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b71cf437-94cf-4a4e-9550-72fbb2f8c637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:47.675583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:47.682393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404b163-4bd1-42e2-bb6f-72ca9e679174 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:47.683176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 69/136] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:47.683949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf437-94cf-4a4e-9550-72fbb2f8c637 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:47.751908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6c9df-d048-45bb-abd8-1dc25e3f1f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:47.753121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6c9df-d048-45bb-abd8-1dc25e3f1f18 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.753583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6c9df-d048-45bb-abd8-1dc25e3f1f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.754035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6c9df-d048-45bb-abd8-1dc25e3f1f18 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.758903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6c9df-d048-45bb-abd8-1dc25e3f1f18 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:47.760668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6c9df-d048-45bb-abd8-1dc25e3f1f18 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:47.762882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 68/137] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:47 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:47.763818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6c9df-d048-45bb-abd8-1dc25e3f1f18 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:47.792233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cf437-94cf-4a4e-9550-72fbb2f8c637 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:47.817484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:47.834503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8a67-b080-4a5c-8a08-25abc3f66bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:47.835689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8a67-b080-4a5c-8a08-25abc3f66bc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.836142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8a67-b080-4a5c-8a08-25abc3f66bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.836768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8a67-b080-4a5c-8a08-25abc3f66bc6 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff/users/4eee573b0bd94bdf970811c775ee4f22/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.840551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d8a67-b080-4a5c-8a08-25abc3f66bc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=90903642dfe940ce8410308d77d923ff, user_id=4eee573b0bd94bdf970811c775ee4f22, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:47.842256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d8a67-b080-4a5c-8a08-25abc3f66bc6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:47.915751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 70/138] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:41:47 2022] PUT /identity/v3/projects/90903642dfe940ce8410308d77d923ff/users/4eee573b0bd94bdf970811c775ee4f22/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:41:47.922088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6c9df-d048-45bb-abd8-1dc25e3f1f18 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:47.922278 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8a67-b080-4a5c-8a08-25abc3f66bc6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:47.982100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3004a9-b428-45c0-acd1-7b3ad8b76956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:47.982100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3004a9-b428-45c0-acd1-7b3ad8b76956 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:47.982100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3004a9-b428-45c0-acd1-7b3ad8b76956 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:47.982100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3004a9-b428-45c0-acd1-7b3ad8b76956 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:47.984246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3004a9-b428-45c0-acd1-7b3ad8b76956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:47.987919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3004a9-b428-45c0-acd1-7b3ad8b76956 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:47.995980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 69/139] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:48.003289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3004a9-b428-45c0-acd1-7b3ad8b76956 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:48.026755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:48.101245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8a67-b080-4a5c-8a08-25abc3f66bc6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:48.175336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0264e6-2591-420b-a467-b07f4c79a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:48.176031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0264e6-2591-420b-a467-b07f4c79a998 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:48.176379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0264e6-2591-420b-a467-b07f4c79a998 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:48.176670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0264e6-2591-420b-a467-b07f4c79a998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:48.177532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0264e6-2591-420b-a467-b07f4c79a998 None admin] RBAC: Adding query filter params (role.id=6d9f69d95e3246a1b656c43e5966fbc6, scope.project.id=90903642dfe940ce8410308d77d923ff, user.id=fc21b5a14ab440a0a6ff06d7671f6c38) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:48.177852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0264e6-2591-420b-a467-b07f4c79a998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:48.179374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0264e6-2591-420b-a467-b07f4c79a998 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:48.196918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 71/140] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:47 2022] GET /identity/v3/role_assignments?user.id=fc21b5a14ab440a0a6ff06d7671f6c38&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=6d9f69d95e3246a1b656c43e5966fbc6 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:48.231487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3004a9-b428-45c0-acd1-7b3ad8b76956 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:48.247635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:48.277058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3f852-621b-4d6d-b7df-c4dee7fce7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:48.277755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f852-621b-4d6d-b7df-c4dee7fce7b4 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:48.278048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f852-621b-4d6d-b7df-c4dee7fce7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:48.278366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3f852-621b-4d6d-b7df-c4dee7fce7b4 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:48.279125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3f852-621b-4d6d-b7df-c4dee7fce7b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:48.280699 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3f852-621b-4d6d-b7df-c4dee7fce7b4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:48.416367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 70/141] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:41:48 2022] POST /identity/v3/users => generated 283 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:41:48.617090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2518-b208-4791-ac55-167cbd36d022 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:48.617690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2518-b208-4791-ac55-167cbd36d022 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:48.617690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb2518-b208-4791-ac55-167cbd36d022 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:48.619333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 72/142] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:48.625844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744ee5a-f8a7-43fc-b9ed-aca505dbc8c4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:48.626237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744ee5a-f8a7-43fc-b9ed-aca505dbc8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:48.626572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744ee5a-f8a7-43fc-b9ed-aca505dbc8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:48.648689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d744ee5a-f8a7-43fc-b9ed-aca505dbc8c4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:48.649923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d744ee5a-f8a7-43fc-b9ed-aca505dbc8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:48.740097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 71/143] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:48.764489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2518-b208-4791-ac55-167cbd36d022 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:48.899775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb2518-b208-4791-ac55-167cbd36d022 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:48.923102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:48.937536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281e39c-b988-4c02-8cfc-c1cb53844885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:48.945748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e39c-b988-4c02-8cfc-c1cb53844885 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:48.945748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e39c-b988-4c02-8cfc-c1cb53844885 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:48.945748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e39c-b988-4c02-8cfc-c1cb53844885 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:48.950888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281e39c-b988-4c02-8cfc-c1cb53844885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b281e39c-b988-4c02-8cfc-c1cb53844885 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:48.960059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:48.961108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:48.961887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 73/144] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:41:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:48.969468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744ee5a-f8a7-43fc-b9ed-aca505dbc8c4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:49.088275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:49.115207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744ee5a-f8a7-43fc-b9ed-aca505dbc8c4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:49.163822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec7d77-b0bb-40f8-9302-64333f779059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:49.164502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec7d77-b0bb-40f8-9302-64333f779059 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:49.164796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec7d77-b0bb-40f8-9302-64333f779059 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:49.165072 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec7d77-b0bb-40f8-9302-64333f779059 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:49.165824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec7d77-b0bb-40f8-9302-64333f779059 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:49.166209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec7d77-b0bb-40f8-9302-64333f779059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:49.167567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec7d77-b0bb-40f8-9302-64333f779059 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:49.181759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 72/145] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:41:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:49.188051 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281e39c-b988-4c02-8cfc-c1cb53844885 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:49.323524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281e39c-b988-4c02-8cfc-c1cb53844885 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:49.347244 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe467-045b-4a02-a31f-9929ecfe7874 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:49.347513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe467-045b-4a02-a31f-9929ecfe7874 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:49.347731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe467-045b-4a02-a31f-9929ecfe7874 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:49.349360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 73/146] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:49.356325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2156-e8a4-4267-838e-ffcdcfe276f2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:49.356616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2156-e8a4-4267-838e-ffcdcfe276f2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:49.357016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2156-e8a4-4267-838e-ffcdcfe276f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:49.366275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb2764-657b-48cd-8ebb-dd1791f88f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:49.367282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2764-657b-48cd-8ebb-dd1791f88f13 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:49.367569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2764-657b-48cd-8ebb-dd1791f88f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:49.367848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2764-657b-48cd-8ebb-dd1791f88f13 None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:49.369091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb2764-657b-48cd-8ebb-dd1791f88f13 None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:49.370566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb2764-657b-48cd-8ebb-dd1791f88f13 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:49.372608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 74/147] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:49 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:49.379977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb2764-657b-48cd-8ebb-dd1791f88f13 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:49.399128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5d2d2156-e8a4-4267-838e-ffcdcfe276f2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:49.400341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5d2d2156-e8a4-4267-838e-ffcdcfe276f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:49.442519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:49.501764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb2764-657b-48cd-8ebb-dd1791f88f13 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:49.546016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f660-d27a-4681-88fe-52bf1ab5467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:49.546696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f660-d27a-4681-88fe-52bf1ab5467e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:49.547029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f660-d27a-4681-88fe-52bf1ab5467e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:49.548254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f660-d27a-4681-88fe-52bf1ab5467e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:49.584938 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 74/148] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:49.620653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f660-d27a-4681-88fe-52bf1ab5467e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:49.622026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14f660-d27a-4681-88fe-52bf1ab5467e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:49.631576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d2156-e8a4-4267-838e-ffcdcfe276f2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:49.682462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:49.727036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 75/149] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:41:49.732531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f660-d27a-4681-88fe-52bf1ab5467e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:49.780978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:49.827885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d2156-e8a4-4267-838e-ffcdcfe276f2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:49.845238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f660-d27a-4681-88fe-52bf1ab5467e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:49.885131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a3b6-62d0-4ceb-a06c-9a0c7951a281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:49.886346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a3b6-62d0-4ceb-a06c-9a0c7951a281 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:49.886927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a3b6-62d0-4ceb-a06c-9a0c7951a281 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:49.887397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713a3b6-62d0-4ceb-a06c-9a0c7951a281 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:49.888828 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713a3b6-62d0-4ceb-a06c-9a0c7951a281 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:49.890839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713a3b6-62d0-4ceb-a06c-9a0c7951a281 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:49.893451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 76/150] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:49 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:41:49.895800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd2462-e3b6-42e5-b9d5-88d3900d3227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:49.896606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd2462-e3b6-42e5-b9d5-88d3900d3227 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:49.896888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd2462-e3b6-42e5-b9d5-88d3900d3227 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:49.897162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd2462-e3b6-42e5-b9d5-88d3900d3227 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:49.899203 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a3b6-62d0-4ceb-a06c-9a0c7951a281 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:49.915578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd2462-e3b6-42e5-b9d5-88d3900d3227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:49.926449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-eecd2462-e3b6-42e5-b9d5-88d3900d3227 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:49.927803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:49.928657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:49.929421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 75/151] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:41:49.939251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd2462-e3b6-42e5-b9d5-88d3900d3227 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:50.015547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713a3b6-62d0-4ceb-a06c-9a0c7951a281 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:50.055653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:50.056738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:50.057216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:50.057747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:50.058850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] RBAC: Adding query filter params (role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=90903642dfe940ce8410308d77d923ff, user.id=777ddb4ee44846a8a21b1b6089e99c6a) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:50.059360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:50.061077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:50.069358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 77/152] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:49 2022] GET /identity/v3/role_assignments?user.id=777ddb4ee44846a8a21b1b6089e99c6a&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:50.091935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd2462-e3b6-42e5-b9d5-88d3900d3227 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:50.132437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:50.149771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:50.149771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:50.149771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:50.149771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:50.150195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:50.150195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:50.150195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:50.162312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 76/153] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:50.167997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:50.269815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:50.291121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaa2d8-3ded-4822-8370-821524fc46c8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:50.338788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea331-3740-478c-8f04-d258fbe53999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:50.339686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea331-3740-478c-8f04-d258fbe53999 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:50.339975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea331-3740-478c-8f04-d258fbe53999 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:50.340252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ea331-3740-478c-8f04-d258fbe53999 None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:50.341483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ea331-3740-478c-8f04-d258fbe53999 None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:50.342951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ea331-3740-478c-8f04-d258fbe53999 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:50.344845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 78/154] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:50 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:50.350542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:50.479294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b15a5f-f720-42c8-a78a-6e0c337dc090 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:50.520953 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bab7f-434f-47ff-92b6-4bfa95067a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:50.521611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bab7f-434f-47ff-92b6-4bfa95067a3b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:50.521896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bab7f-434f-47ff-92b6-4bfa95067a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:50.522209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bab7f-434f-47ff-92b6-4bfa95067a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:50.590834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:50.595363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bab7f-434f-47ff-92b6-4bfa95067a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:50.597314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bab7f-434f-47ff-92b6-4bfa95067a3b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:50.701303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 77/155] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:50.707393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea331-3740-478c-8f04-d258fbe53999 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:50.847945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ea331-3740-478c-8f04-d258fbe53999 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:50.889378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f68f97-1725-4350-aa29-5af894a6cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:50.890523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f68f97-1725-4350-aa29-5af894a6cec7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:50.891350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f68f97-1725-4350-aa29-5af894a6cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:50.891628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f68f97-1725-4350-aa29-5af894a6cec7 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:50.892884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f68f97-1725-4350-aa29-5af894a6cec7 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:50.894327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f68f97-1725-4350-aa29-5af894a6cec7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:50.896045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 79/156] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:50 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:50.899982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33149-8e8e-4af6-a959-3df14093febf None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:50.900284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33149-8e8e-4af6-a959-3df14093febf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:50.900570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33149-8e8e-4af6-a959-3df14093febf None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:50.902213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 78/157] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:50.906202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f68f97-1725-4350-aa29-5af894a6cec7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:50.924356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576b87-42c3-447a-84cc-43a82d99914a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:50.924664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576b87-42c3-447a-84cc-43a82d99914a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:50.924936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576b87-42c3-447a-84cc-43a82d99914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:50.930450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:50.955901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3e576b87-42c3-447a-84cc-43a82d99914a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:50.957260 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3e576b87-42c3-447a-84cc-43a82d99914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:51.045897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f68f97-1725-4350-aa29-5af894a6cec7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:51.081061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 79/158] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:51.099842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:51.100449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:51.100737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:51.101014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:51.101872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] RBAC: Adding query filter params (role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=90903642dfe940ce8410308d77d923ff, user.id=777ddb4ee44846a8a21b1b6089e99c6a) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:51.102222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:51.103682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:51.110981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 80/159] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:50 2022] GET /identity/v3/role_assignments?user.id=777ddb4ee44846a8a21b1b6089e99c6a&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:51.119661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e576b87-42c3-447a-84cc-43a82d99914a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:51.155700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:51.255129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e576b87-42c3-447a-84cc-43a82d99914a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:51.297960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd011d6-c8f3-4534-a3eb-aa3939679036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:51.298985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd011d6-c8f3-4534-a3eb-aa3939679036 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:51.299273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd011d6-c8f3-4534-a3eb-aa3939679036 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:51.299552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd011d6-c8f3-4534-a3eb-aa3939679036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:51.314301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd011d6-c8f3-4534-a3eb-aa3939679036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6cd011d6-c8f3-4534-a3eb-aa3939679036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:51.324514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:51.325453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:51.326302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 80/160] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:51.339264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:51.428572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:51.454184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec981d-5c63-48ae-a7fd-d03b67a89a3d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:51.498743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:51.499435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:51.499721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:51.500025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:51.501423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:51.501731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:51.503173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:51.517793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 81/161] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:51.524265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd011d6-c8f3-4534-a3eb-aa3939679036 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:51.634615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:51.657605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd011d6-c8f3-4534-a3eb-aa3939679036 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:51.701303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a67bd-7460-440c-b9dc-71d27468d5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:51.702116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a67bd-7460-440c-b9dc-71d27468d5bf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:51.702403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a67bd-7460-440c-b9dc-71d27468d5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:51.702677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a67bd-7460-440c-b9dc-71d27468d5bf None admin] PATH_INFO: `/v3/users/777ddb4ee44846a8a21b1b6089e99c6a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:51.704587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a67bd-7460-440c-b9dc-71d27468d5bf None admin] RBAC: Authorizing `identity:get_user(user_id=777ddb4ee44846a8a21b1b6089e99c6a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:51.706121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a67bd-7460-440c-b9dc-71d27468d5bf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:51.707768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 81/162] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:51 2022] GET /identity/v3/users/777ddb4ee44846a8a21b1b6089e99c6a => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:51.713730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:51.860527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2c48-3ed8-437b-9284-72af4d8acd35 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:51.896226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259dc52-e874-496f-aafa-9f170fe7b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:51.896884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259dc52-e874-496f-aafa-9f170fe7b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:51.897165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259dc52-e874-496f-aafa-9f170fe7b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:51.897444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259dc52-e874-496f-aafa-9f170fe7b2c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:51.917632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:51.988193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259dc52-e874-496f-aafa-9f170fe7b2c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:51.989673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259dc52-e874-496f-aafa-9f170fe7b2c8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:52.030405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31ccd-075a-43a2-abb6-39752259b5a0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.030726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31ccd-075a-43a2-abb6-39752259b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.030976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af31ccd-075a-43a2-abb6-39752259b5a0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.033120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 82/163] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:52.047109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66149b-f4b4-4879-a3d0-241696238953 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.047966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66149b-f4b4-4879-a3d0-241696238953 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.048250 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66149b-f4b4-4879-a3d0-241696238953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.083823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4e66149b-f4b4-4879-a3d0-241696238953 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:52.085038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4e66149b-f4b4-4879-a3d0-241696238953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:52.219146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 82/164] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:52.220603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c80-e1ce-4eae-be55-df037ba7462d None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.220891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c80-e1ce-4eae-be55-df037ba7462d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.221167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d25c80-e1ce-4eae-be55-df037ba7462d None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.222596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 83/165] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:52.224927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 83/166] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:52.231013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25c80-e1ce-4eae-be55-df037ba7462d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:52.236311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f513-9b13-4db4-ba02-6a6e20d70e32 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.236606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f513-9b13-4db4-ba02-6a6e20d70e32 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.236885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554f513-9b13-4db4-ba02-6a6e20d70e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.254425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3554f513-9b13-4db4-ba02-6a6e20d70e32 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:52.255663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3554f513-9b13-4db4-ba02-6a6e20d70e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:52.326558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:52.352396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 84/167] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:52.360239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554f513-9b13-4db4-ba02-6a6e20d70e32 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:52.374409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:52.438200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d25c80-e1ce-4eae-be55-df037ba7462d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:52.476854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc60789-64da-4d4d-879d-6174287a005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:52.477799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc60789-64da-4d4d-879d-6174287a005b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.478170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc60789-64da-4d4d-879d-6174287a005b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.478449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc60789-64da-4d4d-879d-6174287a005b None admin] PATH_INFO: `/v3/projects/6f4cfd3291dc476fbcb8ee8cce2d4285` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.479727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc60789-64da-4d4d-879d-6174287a005b None admin] RBAC: Authorizing `identity:get_project(project_id=6f4cfd3291dc476fbcb8ee8cce2d4285)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:52.481327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc60789-64da-4d4d-879d-6174287a005b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:52.483192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 84/168] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:52 2022] GET /identity/v3/projects/6f4cfd3291dc476fbcb8ee8cce2d4285 => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:52.484028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc60789-64da-4d4d-879d-6174287a005b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:52.498270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554f513-9b13-4db4-ba02-6a6e20d70e32 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:52.536089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bfd5f-a0e3-49c3-afa2-980af33a60f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:52.536809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfd5f-a0e3-49c3-afa2-980af33a60f2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.537094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfd5f-a0e3-49c3-afa2-980af33a60f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.537375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bfd5f-a0e3-49c3-afa2-980af33a60f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.549329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bfd5f-a0e3-49c3-afa2-980af33a60f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-023bfd5f-a0e3-49c3-afa2-980af33a60f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:52.557279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:52.558364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:41:52.559151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 85/169] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:52.560873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559492-8742-4154-b1c7-62fd87707455 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.562912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559492-8742-4154-b1c7-62fd87707455 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.562912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38559492-8742-4154-b1c7-62fd87707455 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.562912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 86/170] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:52.567639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559492-8742-4154-b1c7-62fd87707455 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:52.595151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc60789-64da-4d4d-879d-6174287a005b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:52.606978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:52.633035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae547-46c5-4977-a9ab-8338e420def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:52.633978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae547-46c5-4977-a9ab-8338e420def4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.635217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae547-46c5-4977-a9ab-8338e420def4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.635512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae547-46c5-4977-a9ab-8338e420def4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.645235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:52.648656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae547-46c5-4977-a9ab-8338e420def4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-580ae547-46c5-4977-a9ab-8338e420def4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:52.657450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:52.662821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 85/171] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:52.665077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae547-46c5-4977-a9ab-8338e420def4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:52.680342 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38559492-8742-4154-b1c7-62fd87707455 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:52.716450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c170ef-bd94-4720-8abb-0528ad2651b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:52.717107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c170ef-bd94-4720-8abb-0528ad2651b0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.717393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c170ef-bd94-4720-8abb-0528ad2651b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.717667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c170ef-bd94-4720-8abb-0528ad2651b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.719306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c170ef-bd94-4720-8abb-0528ad2651b0 None admin] RBAC: Adding query filter params (role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=6f4cfd3291dc476fbcb8ee8cce2d4285, user.id=777ddb4ee44846a8a21b1b6089e99c6a) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:52.719702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c170ef-bd94-4720-8abb-0528ad2651b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:52.721158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c170ef-bd94-4720-8abb-0528ad2651b0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:52.727567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 87/172] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:52 2022] GET /identity/v3/role_assignments?user.id=777ddb4ee44846a8a21b1b6089e99c6a&scope.project.id=6f4cfd3291dc476fbcb8ee8cce2d4285&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:52.728690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352d7f1-e9c8-41a2-a9ea-09233a7bb518 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.728982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352d7f1-e9c8-41a2-a9ea-09233a7bb518 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.729266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352d7f1-e9c8-41a2-a9ea-09233a7bb518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.748037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d352d7f1-e9c8-41a2-a9ea-09233a7bb518 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:52.749302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d352d7f1-e9c8-41a2-a9ea-09233a7bb518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:52.771905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae547-46c5-4977-a9ab-8338e420def4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:52.810600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:52.811324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.811609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.811883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.813186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:52.813493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:52.815128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:52.824535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 86/173] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:52.825371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:52.825833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 88/174] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:52.831839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352d7f1-e9c8-41a2-a9ea-09233a7bb518 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:52.863229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:52.940991 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3f358-17ee-4d33-ac97-fff858b7a581 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:52.979174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:52.979749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:52.980035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:52.980311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:52.981065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:52.981370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:52.982753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:52.992532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 87/175] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:52.993676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:52.996737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:53.042460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352d7f1-e9c8-41a2-a9ea-09233a7bb518 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.081422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2497-6e34-4d8e-9963-2b5718e3c6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.082351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2497-6e34-4d8e-9963-2b5718e3c6fa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.082783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2497-6e34-4d8e-9963-2b5718e3c6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.083123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed2497-6e34-4d8e-9963-2b5718e3c6fa None admin] PATH_INFO: `/v3/users/4eee573b0bd94bdf970811c775ee4f22` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.084509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed2497-6e34-4d8e-9963-2b5718e3c6fa None admin] RBAC: Authorizing `identity:get_user(user_id=4eee573b0bd94bdf970811c775ee4f22)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:53.086019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed2497-6e34-4d8e-9963-2b5718e3c6fa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:53.088275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 89/176] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:52 2022] GET /identity/v3/users/4eee573b0bd94bdf970811c775ee4f22 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:53.089188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2497-6e34-4d8e-9963-2b5718e3c6fa None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.098764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:53.106160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c481-b2b4-47e1-811b-49c7f758ee03 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.143930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b785420-874d-477f-ab13-ccbd6148d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.145081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b785420-874d-477f-ab13-ccbd6148d547 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.145581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b785420-874d-477f-ab13-ccbd6148d547 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.146097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b785420-874d-477f-ab13-ccbd6148d547 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.159077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b785420-874d-477f-ab13-ccbd6148d547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2b785420-874d-477f-ab13-ccbd6148d547 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:53.167058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:53.167934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:53.168719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:53.171053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 88/177] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:53.172589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b785420-874d-477f-ab13-ccbd6148d547 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.210808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed2497-6e34-4d8e-9963-2b5718e3c6fa None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.244952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:53.251099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257493fc-5489-4b31-809c-bc86c9bc341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.252011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257493fc-5489-4b31-809c-bc86c9bc341a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.252297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257493fc-5489-4b31-809c-bc86c9bc341a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.252578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257493fc-5489-4b31-809c-bc86c9bc341a None admin] PATH_INFO: `/v3/users/fc21b5a14ab440a0a6ff06d7671f6c38` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.253787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257493fc-5489-4b31-809c-bc86c9bc341a None admin] RBAC: Authorizing `identity:get_user(user_id=fc21b5a14ab440a0a6ff06d7671f6c38)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:53.255273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257493fc-5489-4b31-809c-bc86c9bc341a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:53.256903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 90/178] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:53 2022] GET /identity/v3/users/fc21b5a14ab440a0a6ff06d7671f6c38 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:53.258093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f868-251c-4026-8f40-ac98c50b4d3f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.258382 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f868-251c-4026-8f40-ac98c50b4d3f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.258661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f868-251c-4026-8f40-ac98c50b4d3f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.259885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 91/179] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:53.260583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f868-251c-4026-8f40-ac98c50b4d3f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.287029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b785420-874d-477f-ab13-ccbd6148d547 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.323315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d684d07-1aab-4fc0-a0f9-465bac2b7c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.323962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684d07-1aab-4fc0-a0f9-465bac2b7c1d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.324304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684d07-1aab-4fc0-a0f9-465bac2b7c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.324579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d684d07-1aab-4fc0-a0f9-465bac2b7c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.350626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:53.370029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f868-251c-4026-8f40-ac98c50b4d3f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.397471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d684d07-1aab-4fc0-a0f9-465bac2b7c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:53.398969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d684d07-1aab-4fc0-a0f9-465bac2b7c1d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:53.404960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.405633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.405917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.406925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.407843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:53.408155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:53.409768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:53.418420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 92/180] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:53.419056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.482759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:53.501133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 89/181] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:53.502524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adca6-0324-4775-a65c-566cf6682d70 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.502811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adca6-0324-4775-a65c-566cf6682d70 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.503083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adca6-0324-4775-a65c-566cf6682d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.519158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-165adca6-0324-4775-a65c-566cf6682d70 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:53.520336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-165adca6-0324-4775-a65c-566cf6682d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:53.521221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42fbe5-f886-49c9-9008-8f6d69b1a8e6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.554869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b77232-f8ab-4c5c-86a8-cb3f44531173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.555721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77232-f8ab-4c5c-86a8-cb3f44531173 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.555998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77232-f8ab-4c5c-86a8-cb3f44531173 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.556267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77232-f8ab-4c5c-86a8-cb3f44531173 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.557444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b77232-f8ab-4c5c-86a8-cb3f44531173 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:53.558891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b77232-f8ab-4c5c-86a8-cb3f44531173 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:53.560578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 93/182] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:53 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:53.560578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b77232-f8ab-4c5c-86a8-cb3f44531173 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.569595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:53.588169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 90/183] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:53.589529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9a9b0-2343-4032-8df5-3e7db8d8c4c4 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.589818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9a9b0-2343-4032-8df5-3e7db8d8c4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.590111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9a9b0-2343-4032-8df5-3e7db8d8c4c4 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.591380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 91/184] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:53.592063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9a9b0-2343-4032-8df5-3e7db8d8c4c4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.676605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b77232-f8ab-4c5c-86a8-cb3f44531173 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.707100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:53.709617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9a9b0-2343-4032-8df5-3e7db8d8c4c4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.712881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d248-1a43-427d-ac34-87660dbee83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.713751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d248-1a43-427d-ac34-87660dbee83a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.714035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d248-1a43-427d-ac34-87660dbee83a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.714341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d248-1a43-427d-ac34-87660dbee83a None admin] PATH_INFO: `/v3/users/ac73bbdf8c4140b9b613669613c3b5b7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.729368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d248-1a43-427d-ac34-87660dbee83a None admin] RBAC: Authorizing `identity:get_user(user_id=ac73bbdf8c4140b9b613669613c3b5b7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:53.730848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d248-1a43-427d-ac34-87660dbee83a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:53.732529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 94/185] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:53 2022] GET /identity/v3/users/ac73bbdf8c4140b9b613669613c3b5b7 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:53.733264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d248-1a43-427d-ac34-87660dbee83a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.750002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be8bb2-96f3-4d61-9f6f-b5906f60d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.751103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be8bb2-96f3-4d61-9f6f-b5906f60d536 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.751397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be8bb2-96f3-4d61-9f6f-b5906f60d536 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.751677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be8bb2-96f3-4d61-9f6f-b5906f60d536 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.752877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be8bb2-96f3-4d61-9f6f-b5906f60d536 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:53.754350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be8bb2-96f3-4d61-9f6f-b5906f60d536 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:53.756059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 92/186] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:53 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:53.757274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4a4f-84eb-468e-950f-d4d70466cae4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.757565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4a4f-84eb-468e-950f-d4d70466cae4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.757849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4a4f-84eb-468e-950f-d4d70466cae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.774622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3f4c4a4f-84eb-468e-950f-d4d70466cae4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:53.775819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3f4c4a4f-84eb-468e-950f-d4d70466cae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:53.825041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:53.832875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d248-1a43-427d-ac34-87660dbee83a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.847645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 93/187] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:53.848651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4a4f-84eb-468e-950f-d4d70466cae4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.877762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f862d-931d-4bac-9525-e22b1b979564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.878664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f862d-931d-4bac-9525-e22b1b979564 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.878949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f862d-931d-4bac-9525-e22b1b979564 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.879222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f862d-931d-4bac-9525-e22b1b979564 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff/users/fc21b5a14ab440a0a6ff06d7671f6c38/roles/6d9f69d95e3246a1b656c43e5966fbc6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:53.881163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f862d-931d-4bac-9525-e22b1b979564 None admin] RBAC: Authorizing `identity:create_grant(project_id=90903642dfe940ce8410308d77d923ff, user_id=fc21b5a14ab440a0a6ff06d7671f6c38, role_id=6d9f69d95e3246a1b656c43e5966fbc6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:53.882714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f862d-931d-4bac-9525-e22b1b979564 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:53.947547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4a4f-84eb-468e-950f-d4d70466cae4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:53.949228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 95/188] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:41:53 2022] PUT /identity/v3/projects/90903642dfe940ce8410308d77d923ff/users/fc21b5a14ab440a0a6ff06d7671f6c38/roles/6d9f69d95e3246a1b656c43e5966fbc6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:41:53.956586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f862d-931d-4bac-9525-e22b1b979564 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:53.992906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f531a-f240-4f87-bad9-078826de5630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:53.993737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f531a-f240-4f87-bad9-078826de5630 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:53.994021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f531a-f240-4f87-bad9-078826de5630 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:53.994336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f531a-f240-4f87-bad9-078826de5630 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.006979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f531a-f240-4f87-bad9-078826de5630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0b5f531a-f240-4f87-bad9-078826de5630 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:54.016057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:54.017297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:54.018123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 94/189] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:41:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:54.019394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f531a-f240-4f87-bad9-078826de5630 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:54.026229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:54.073567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:54.088134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f862d-931d-4bac-9525-e22b1b979564 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.133045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec1d9d-5561-4b05-bf23-11981d506e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.133700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1d9d-5561-4b05-bf23-11981d506e76 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.133983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1d9d-5561-4b05-bf23-11981d506e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.134417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1d9d-5561-4b05-bf23-11981d506e76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.143306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f531a-f240-4f87-bad9-078826de5630 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.178488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.179174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.179458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.179736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.180568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=90903642dfe940ce8410308d77d923ff, user.id=4eee573b0bd94bdf970811c775ee4f22) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:54.180882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:54.182336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:54.189172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 95/190] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:54 2022] GET /identity/v3/role_assignments?user.id=4eee573b0bd94bdf970811c775ee4f22&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:54.189977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:54.217467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec1d9d-5561-4b05-bf23-11981d506e76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:54.219109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec1d9d-5561-4b05-bf23-11981d506e76 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:54.285041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:54.322334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5eebdc-5077-4959-ade2-c50babbc1e11 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.330859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:54.346522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 96/191] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:54.352175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec1d9d-5561-4b05-bf23-11981d506e76 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:54.365333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e501128-776f-4188-a7c2-a68de067fb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.367418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501128-776f-4188-a7c2-a68de067fb7d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.367890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501128-776f-4188-a7c2-a68de067fb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.368424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501128-776f-4188-a7c2-a68de067fb7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.369978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e501128-776f-4188-a7c2-a68de067fb7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:54.371649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e501128-776f-4188-a7c2-a68de067fb7d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:54.373305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 96/192] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:54.374095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e501128-776f-4188-a7c2-a68de067fb7d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:54.478948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec1d9d-5561-4b05-bf23-11981d506e76 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.503237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e501128-776f-4188-a7c2-a68de067fb7d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.516601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.517427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.517733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.518085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.518883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:54.519196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:54.520567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:54.533152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 97/193] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:41:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:54.534214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:54.544128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f95162-1f30-4b6a-a830-55026124c373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.551650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f95162-1f30-4b6a-a830-55026124c373 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.551650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f95162-1f30-4b6a-a830-55026124c373 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.551650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f95162-1f30-4b6a-a830-55026124c373 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.551650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f95162-1f30-4b6a-a830-55026124c373 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:54.551910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:54.551989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f95162-1f30-4b6a-a830-55026124c373 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:54.551989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 97/194] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:54 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:54.551989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f95162-1f30-4b6a-a830-55026124c373 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:54.603345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:54.650324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5717b-f672-4a03-a5c6-910bf65afb31 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.665375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f95162-1f30-4b6a-a830-55026124c373 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.686387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49df6-40b5-4f2c-b2ba-e416c3b738cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.687198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49df6-40b5-4f2c-b2ba-e416c3b738cc None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.688019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49df6-40b5-4f2c-b2ba-e416c3b738cc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.688300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f49df6-40b5-4f2c-b2ba-e416c3b738cc None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.688999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f49df6-40b5-4f2c-b2ba-e416c3b738cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:54.690471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f49df6-40b5-4f2c-b2ba-e416c3b738cc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:54.701293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0834c-8d4b-4781-9978-ecc101639299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.702212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0834c-8d4b-4781-9978-ecc101639299 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.702499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0834c-8d4b-4781-9978-ecc101639299 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.702780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0834c-8d4b-4781-9978-ecc101639299 None admin] PATH_INFO: `/v3/users/ac73bbdf8c4140b9b613669613c3b5b7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.704307 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0834c-8d4b-4781-9978-ecc101639299 None admin] RBAC: Authorizing `identity:get_user(user_id=ac73bbdf8c4140b9b613669613c3b5b7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:54.705736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0834c-8d4b-4781-9978-ecc101639299 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:54.707426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 98/195] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:54 2022] GET /identity/v3/users/ac73bbdf8c4140b9b613669613c3b5b7 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:54.711900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0834c-8d4b-4781-9978-ecc101639299 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:54.774293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 98/196] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:41:54 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:54.775066 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49df6-40b5-4f2c-b2ba-e416c3b738cc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:54.827218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0834c-8d4b-4781-9978-ecc101639299 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.842347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:54.874555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:54.880218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.881473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.881760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.882040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:54.883536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=bfc98143553e408eab2fd06c84a65bdd, user.id=ac73bbdf8c4140b9b613669613c3b5b7) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:54.886382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:54.886382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:54.898275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 99/197] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:54 2022] GET /identity/v3/role_assignments?user.id=ac73bbdf8c4140b9b613669613c3b5b7&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:54.916878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f49df6-40b5-4f2c-b2ba-e416c3b738cc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:54.958003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9c1a1-e0a4-47ac-8f96-1664bddacc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:54.958991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9c1a1-e0a4-47ac-8f96-1664bddacc4b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:54.959420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9c1a1-e0a4-47ac-8f96-1664bddacc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:54.959841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9c1a1-e0a4-47ac-8f96-1664bddacc4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:55.043578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9c1a1-e0a4-47ac-8f96-1664bddacc4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:55.045301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9c1a1-e0a4-47ac-8f96-1664bddacc4b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:55.120920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:55.162320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 99/198] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:55.168630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:55.281155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5996f0-13ce-4601-840e-3c2289c59f1b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:55.325752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a5f7a-7b18-402a-af03-09846fb423c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:55.326586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f7a-7b18-402a-af03-09846fb423c5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:55.326867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f7a-7b18-402a-af03-09846fb423c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:55.327142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a5f7a-7b18-402a-af03-09846fb423c5 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:55.328865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5f7a-7b18-402a-af03-09846fb423c5 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:55.330320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a5f7a-7b18-402a-af03-09846fb423c5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:55.332192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 100/199] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:55 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:55.337749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9c1a1-e0a4-47ac-8f96-1664bddacc4b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:55.449165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9c1a1-e0a4-47ac-8f96-1664bddacc4b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:55.483189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d2930-e5e8-4d6b-9025-7b5edbc24af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:55.483845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2930-e5e8-4d6b-9025-7b5edbc24af8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:55.484127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2930-e5e8-4d6b-9025-7b5edbc24af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:55.484919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d2930-e5e8-4d6b-9025-7b5edbc24af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:55.485749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d2930-e5e8-4d6b-9025-7b5edbc24af8 None admin] RBAC: Adding query filter params (role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=bfc98143553e408eab2fd06c84a65bdd, user.id=ac73bbdf8c4140b9b613669613c3b5b7) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:55.486077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d2930-e5e8-4d6b-9025-7b5edbc24af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:55.487516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d2930-e5e8-4d6b-9025-7b5edbc24af8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:55.493541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 100/200] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:55 2022] GET /identity/v3/role_assignments?user.id=ac73bbdf8c4140b9b613669613c3b5b7&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:56.261675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d376-fa60-49f3-a123-571a559ac508 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:56.262233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d376-fa60-49f3-a123-571a559ac508 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:56.262233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d376-fa60-49f3-a123-571a559ac508 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:56.263869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 101/201] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:56.275433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ce0-f9dc-4992-8afd-da5cbebac691 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:56.275957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ce0-f9dc-4992-8afd-da5cbebac691 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:56.276177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ce0-f9dc-4992-8afd-da5cbebac691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:56.303331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a8a93ce0-f9dc-4992-8afd-da5cbebac691 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:56.304559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a8a93ce0-f9dc-4992-8afd-da5cbebac691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:56.335045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:56.395391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 101/202] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:56.430160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d376-fa60-49f3-a123-571a559ac508 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:56.489824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:56.563438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d376-fa60-49f3-a123-571a559ac508 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:56.602090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d7e3e-dfbd-4538-a7d3-9d478594cd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:56.602897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d7e3e-dfbd-4538-a7d3-9d478594cd60 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:56.603180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d7e3e-dfbd-4538-a7d3-9d478594cd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:56.603458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d7e3e-dfbd-4538-a7d3-9d478594cd60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:56.623001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d7e3e-dfbd-4538-a7d3-9d478594cd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-9a5d7e3e-dfbd-4538-a7d3-9d478594cd60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:56.631629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:56.632523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:41:56.633403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:56.638523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 102/203] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:56.647161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a93ce0-f9dc-4992-8afd-da5cbebac691 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:56.784701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a93ce0-f9dc-4992-8afd-da5cbebac691 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:56.819270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:56.819864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:56.820145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:56.820420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:56.821173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:56.821480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:56.822888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:56.845151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 102/204] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:56.855151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d7e3e-dfbd-4538-a7d3-9d478594cd60 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:57.005519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d7e3e-dfbd-4538-a7d3-9d478594cd60 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:57.007071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:57.039568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1ec23-333b-489b-982e-7070c85dffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:57.040498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1ec23-333b-489b-982e-7070c85dffbf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.040777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1ec23-333b-489b-982e-7070c85dffbf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.041107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1ec23-333b-489b-982e-7070c85dffbf None admin] PATH_INFO: `/v3/users/fc21b5a14ab440a0a6ff06d7671f6c38` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.042338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1ec23-333b-489b-982e-7070c85dffbf None admin] RBAC: Authorizing `identity:get_user(user_id=fc21b5a14ab440a0a6ff06d7671f6c38)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:57.043757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1ec23-333b-489b-982e-7070c85dffbf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:57.045681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 103/205] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:56 2022] GET /identity/v3/users/fc21b5a14ab440a0a6ff06d7671f6c38 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:57.052060 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:57.085670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:57.178525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99d43f-2ab2-4813-a303-26d4736ecbfe None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:57.213878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbbca5-8b2a-4e68-a507-2b7639634f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:57.214553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbbca5-8b2a-4e68-a507-2b7639634f1f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.214836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbbca5-8b2a-4e68-a507-2b7639634f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.215110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbbca5-8b2a-4e68-a507-2b7639634f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.288283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbbca5-8b2a-4e68-a507-2b7639634f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:57.289749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbbca5-8b2a-4e68-a507-2b7639634f1f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:57.324650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:57.423773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 103/206] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:57.431520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1ec23-333b-489b-982e-7070c85dffbf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:57.431983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d94e1-6d78-43d8-bd45-bc939af510ce None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.432256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d94e1-6d78-43d8-bd45-bc939af510ce None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.432472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d94e1-6d78-43d8-bd45-bc939af510ce None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.434090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 104/207] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:57.440571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccae1e-1e92-494c-a3c4-f4c635e406c0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.440858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccae1e-1e92-494c-a3c4-f4c635e406c0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.441135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccae1e-1e92-494c-a3c4-f4c635e406c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.460259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f8ccae1e-1e92-494c-a3c4-f4c635e406c0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:57.461594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f8ccae1e-1e92-494c-a3c4-f4c635e406c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:57.547303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 105/208] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:57.548747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41679e-7d71-46d5-b04c-75842eb8972c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.549033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41679e-7d71-46d5-b04c-75842eb8972c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.550654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41679e-7d71-46d5-b04c-75842eb8972c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.551062 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 106/209] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:57.556473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3410-4f65-43e8-898c-803fd97df060 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.556762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3410-4f65-43e8-898c-803fd97df060 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.557039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3410-4f65-43e8-898c-803fd97df060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.575135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c46d3410-4f65-43e8-898c-803fd97df060 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:57.576519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c46d3410-4f65-43e8-898c-803fd97df060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:57.590435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1ec23-333b-489b-982e-7070c85dffbf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:57.626761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236e9f7-e374-4246-8fb2-babbd2765f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:57.627722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236e9f7-e374-4246-8fb2-babbd2765f69 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.628090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236e9f7-e374-4246-8fb2-babbd2765f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.628432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236e9f7-e374-4246-8fb2-babbd2765f69 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.629702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236e9f7-e374-4246-8fb2-babbd2765f69 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:57.631287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236e9f7-e374-4246-8fb2-babbd2765f69 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:57.633352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 104/210] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:57 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:57.634237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236e9f7-e374-4246-8fb2-babbd2765f69 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:57.644365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:57.674221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 107/211] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:41:57.675584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d3410-4f65-43e8-898c-803fd97df060 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:57.692331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:57.771052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236e9f7-e374-4246-8fb2-babbd2765f69 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:57.811406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d3410-4f65-43e8-898c-803fd97df060 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:57.817889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaabe5-7a45-4a5c-972d-75c70788f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:57.818900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaabe5-7a45-4a5c-972d-75c70788f9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.819320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaabe5-7a45-4a5c-972d-75c70788f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.820227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaabe5-7a45-4a5c-972d-75c70788f9e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.834967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadaabe5-7a45-4a5c-972d-75c70788f9e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-aadaabe5-7a45-4a5c-972d-75c70788f9e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:57.845651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:57.846755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:41:57.847518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:57.848099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 105/212] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:57.853190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaabe5-7a45-4a5c-972d-75c70788f9e5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:57.858794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:57.860129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:57.860416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:57.860688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:57.861586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] RBAC: Adding query filter params (role.id=6d9f69d95e3246a1b656c43e5966fbc6, scope.project.id=90903642dfe940ce8410308d77d923ff, user.id=fc21b5a14ab440a0a6ff06d7671f6c38) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:57.861900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:57.863350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:57.870224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 108/213] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:57 2022] GET /identity/v3/role_assignments?user.id=fc21b5a14ab440a0a6ff06d7671f6c38&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=6d9f69d95e3246a1b656c43e5966fbc6 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:57.870753 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:57.969017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.018424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.023491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaabe5-7a45-4a5c-972d-75c70788f9e5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.048082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4c1bd-a476-42be-acf1-82a6a2f8996e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.073247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6c113-4ad7-406f-bce7-e532e53ca4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.074075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c113-4ad7-406f-bce7-e532e53ca4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.074387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c113-4ad7-406f-bce7-e532e53ca4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.074672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c113-4ad7-406f-bce7-e532e53ca4f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.088328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6c113-4ad7-406f-bce7-e532e53ca4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:58.090600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea46b44-e078-44e0-a3fe-1ec3607e379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.091279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea46b44-e078-44e0-a3fe-1ec3607e379c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.091563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea46b44-e078-44e0-a3fe-1ec3607e379c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.091847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea46b44-e078-44e0-a3fe-1ec3607e379c None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.092607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea46b44-e078-44e0-a3fe-1ec3607e379c None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:58.092916 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea46b44-e078-44e0-a3fe-1ec3607e379c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.094895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea46b44-e078-44e0-a3fe-1ec3607e379c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-e2b6c113-4ad7-406f-bce7-e532e53ca4f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:58.099247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:58.100129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:41:58.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:58.101550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 106/214] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:58.102447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6f876-81d3-469d-ac78-f8686dfbd8a7 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.102547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6f876-81d3-469d-ac78-f8686dfbd8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.102770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6f876-81d3-469d-ac78-f8686dfbd8a7 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.103553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 109/215] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:41:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:58.104410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 107/216] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:58.108296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89443f-f10e-4a6d-afc0-07f0891a6ad7 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.108660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89443f-f10e-4a6d-afc0-07f0891a6ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.108925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89443f-f10e-4a6d-afc0-07f0891a6ad7 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.109337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6f876-81d3-469d-ac78-f8686dfbd8a7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.111304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 110/217] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:41:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:41:58.113018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89443f-f10e-4a6d-afc0-07f0891a6ad7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.213374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6f876-81d3-469d-ac78-f8686dfbd8a7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.218445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89443f-f10e-4a6d-afc0-07f0891a6ad7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.227609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.246593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0447ee1-f565-406d-b675-5ea11fccd2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.247254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447ee1-f565-406d-b675-5ea11fccd2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.247535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447ee1-f565-406d-b675-5ea11fccd2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.247808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0447ee1-f565-406d-b675-5ea11fccd2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.248543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0447ee1-f565-406d-b675-5ea11fccd2c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:58.248847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0447ee1-f565-406d-b675-5ea11fccd2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.250917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0447ee1-f565-406d-b675-5ea11fccd2c7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.252935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ec233-f404-4bc2-ad18-71f8781fbcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.253805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec233-f404-4bc2-ad18-71f8781fbcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.254112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec233-f404-4bc2-ad18-71f8781fbcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.254394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec233-f404-4bc2-ad18-71f8781fbcb4 None admin] PATH_INFO: `/v3/users/250e1e8e5a814bcb814f8fcb41bde905` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.260283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 108/218] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:58.263782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dce60-6976-4eaa-baf7-e3b576afc90b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.264092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dce60-6976-4eaa-baf7-e3b576afc90b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.264350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dce60-6976-4eaa-baf7-e3b576afc90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.268603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ec233-f404-4bc2-ad18-71f8781fbcb4 None admin] RBAC: Authorizing `identity:get_user(user_id=250e1e8e5a814bcb814f8fcb41bde905)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.270238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ec233-f404-4bc2-ad18-71f8781fbcb4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.272716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 111/219] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/users/250e1e8e5a814bcb814f8fcb41bde905 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:58.273891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53477-91d5-4cf2-899e-ffbaee1ca109 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.274201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53477-91d5-4cf2-899e-ffbaee1ca109 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.274478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53477-91d5-4cf2-899e-ffbaee1ca109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.280855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-289dce60-6976-4eaa-baf7-e3b576afc90b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:58.282666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-289dce60-6976-4eaa-baf7-e3b576afc90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:58.291854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dfd53477-91d5-4cf2-899e-ffbaee1ca109 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:41:58.292998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dfd53477-91d5-4cf2-899e-ffbaee1ca109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:41:58.297466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.351271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 109/220] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:58.352204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dce60-6976-4eaa-baf7-e3b576afc90b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.367555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 112/221] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:41:58.375752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53477-91d5-4cf2-899e-ffbaee1ca109 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.454711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dce60-6976-4eaa-baf7-e3b576afc90b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.469116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.474942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53477-91d5-4cf2-899e-ffbaee1ca109 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.487838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bdcde-0943-48a8-8f6c-e04e019f09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.488649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bdcde-0943-48a8-8f6c-e04e019f09bc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.488931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bdcde-0943-48a8-8f6c-e04e019f09bc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.489204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bdcde-0943-48a8-8f6c-e04e019f09bc None admin] PATH_INFO: `/v3/users/ac73bbdf8c4140b9b613669613c3b5b7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.490422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bdcde-0943-48a8-8f6c-e04e019f09bc None admin] RBAC: Authorizing `identity:get_user(user_id=ac73bbdf8c4140b9b613669613c3b5b7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.491908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bdcde-0943-48a8-8f6c-e04e019f09bc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.493594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 110/222] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/users/ac73bbdf8c4140b9b613669613c3b5b7 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:58.494377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bdcde-0943-48a8-8f6c-e04e019f09bc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.511428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba85d8-9052-466d-91e0-98e794327399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.512082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba85d8-9052-466d-91e0-98e794327399 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba85d8-9052-466d-91e0-98e794327399 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.512654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba85d8-9052-466d-91e0-98e794327399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.515424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.583836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba85d8-9052-466d-91e0-98e794327399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.585290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba85d8-9052-466d-91e0-98e794327399 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.595233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bdcde-0943-48a8-8f6c-e04e019f09bc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.631021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe53fa8-7979-4c4d-b84f-32286824c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.632083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53fa8-7979-4c4d-b84f-32286824c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.632368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53fa8-7979-4c4d-b84f-32286824c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.632645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe53fa8-7979-4c4d-b84f-32286824c1e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.633817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe53fa8-7979-4c4d-b84f-32286824c1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.635284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe53fa8-7979-4c4d-b84f-32286824c1e5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.636932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 111/223] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:58.636932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe53fa8-7979-4c4d-b84f-32286824c1e5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.680475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.686619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 113/224] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:41:58.691363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba85d8-9052-466d-91e0-98e794327399 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.729339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.745471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe53fa8-7979-4c4d-b84f-32286824c1e5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.779477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0673-0057-40fb-8852-1860e4d81228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.780280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0673-0057-40fb-8852-1860e4d81228 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.780564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0673-0057-40fb-8852-1860e4d81228 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.780837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0673-0057-40fb-8852-1860e4d81228 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.788071 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba85d8-9052-466d-91e0-98e794327399 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.791599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c0673-0057-40fb-8852-1860e4d81228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-5b2c0673-0057-40fb-8852-1860e4d81228 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:41:58.800320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:41:58.801336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:41:58.802293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 112/225] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:41:58.803200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0673-0057-40fb-8852-1860e4d81228 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.830243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a4288-74e1-48ad-a6f7-ec7209da29a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.831366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4288-74e1-48ad-a6f7-ec7209da29a1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.831645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4288-74e1-48ad-a6f7-ec7209da29a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.831918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a4288-74e1-48ad-a6f7-ec7209da29a1 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.833115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a4288-74e1-48ad-a6f7-ec7209da29a1 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.834622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a4288-74e1-48ad-a6f7-ec7209da29a1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.836317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 114/226] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:58.837088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a4288-74e1-48ad-a6f7-ec7209da29a1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:58.898801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:58.905443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0673-0057-40fb-8852-1860e4d81228 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.936570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a4288-74e1-48ad-a6f7-ec7209da29a1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:58.938711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d4f00-d4e4-4460-86e0-fb36484db9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.939380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4f00-d4e4-4460-86e0-fb36484db9e9 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.939667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4f00-d4e4-4460-86e0-fb36484db9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.939946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d4f00-d4e4-4460-86e0-fb36484db9e9 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.940647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d4f00-d4e4-4460-86e0-fb36484db9e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.942084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d4f00-d4e4-4460-86e0-fb36484db9e9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.971009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9d885-7cc0-4748-8fbd-bb9d22fed90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:58.971905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9d885-7cc0-4748-8fbd-bb9d22fed90a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:58.972190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9d885-7cc0-4748-8fbd-bb9d22fed90a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:58.972469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9d885-7cc0-4748-8fbd-bb9d22fed90a None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:58.973638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9d885-7cc0-4748-8fbd-bb9d22fed90a None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:58.975101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9d885-7cc0-4748-8fbd-bb9d22fed90a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:58.976801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 115/227] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:58.977565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9d885-7cc0-4748-8fbd-bb9d22fed90a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:59.030128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 113/228] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:41:58 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:41:59.030946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d4f00-d4e4-4460-86e0-fb36484db9e9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:59.034409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:59.084144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9d885-7cc0-4748-8fbd-bb9d22fed90a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:59.116520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:59.121254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:59.121931 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.122246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.122573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.123336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:59.123651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:59.125518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:59.135313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 116/229] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:41:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:59.136067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:59.152878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d4f00-d4e4-4460-86e0-fb36484db9e9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:59.194925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aceea-6f71-41e3-9771-ee1fcf950a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:59.195839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aceea-6f71-41e3-9771-ee1fcf950a85 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.196493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aceea-6f71-41e3-9771-ee1fcf950a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.196493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aceea-6f71-41e3-9771-ee1fcf950a85 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd/users/ac73bbdf8c4140b9b613669613c3b5b7/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.198407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aceea-6f71-41e3-9771-ee1fcf950a85 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc98143553e408eab2fd06c84a65bdd, user_id=ac73bbdf8c4140b9b613669613c3b5b7, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:59.199867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aceea-6f71-41e3-9771-ee1fcf950a85 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:59.249623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374faddf-95c6-46c1-b970-6303148f8328 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:59.265437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 114/230] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:41:59 2022] PUT /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd/users/ac73bbdf8c4140b9b613669613c3b5b7/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:41:59.266826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aceea-6f71-41e3-9771-ee1fcf950a85 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:59.313070 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:59.313763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.314003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.314388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.315253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] RBAC: Adding query filter params (role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=bfc98143553e408eab2fd06c84a65bdd, user.id=250e1e8e5a814bcb814f8fcb41bde905) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:41:59.315568 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:59.317187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:59.324976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 117/231] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:41:59 2022] GET /identity/v3/role_assignments?user.id=250e1e8e5a814bcb814f8fcb41bde905&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:59.379725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:59.428910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aceea-6f71-41e3-9771-ee1fcf950a85 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:59.468929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbdd95-d856-4cf3-ba12-3fc29b4ab4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:59.470811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbdd95-d856-4cf3-ba12-3fc29b4ab4fc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.471246 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbdd95-d856-4cf3-ba12-3fc29b4ab4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.471667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbdd95-d856-4cf3-ba12-3fc29b4ab4fc None admin] PATH_INFO: `/v3/users/ac73bbdf8c4140b9b613669613c3b5b7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.473288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbdd95-d856-4cf3-ba12-3fc29b4ab4fc None admin] RBAC: Authorizing `identity:get_user(user_id=ac73bbdf8c4140b9b613669613c3b5b7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:59.474937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbdd95-d856-4cf3-ba12-3fc29b4ab4fc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:59.476847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 115/232] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:41:59 2022] GET /identity/v3/users/ac73bbdf8c4140b9b613669613c3b5b7 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:59.482718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:59.551902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:59.605455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94640d04-e035-4596-aa85-d37f7842b73d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:59.643140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ed4c9-627d-47a5-a2c0-b936d96853d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:59.644312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed4c9-627d-47a5-a2c0-b936d96853d1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.644801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed4c9-627d-47a5-a2c0-b936d96853d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.645249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed4c9-627d-47a5-a2c0-b936d96853d1 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.646749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ed4c9-627d-47a5-a2c0-b936d96853d1 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:59.648387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ed4c9-627d-47a5-a2c0-b936d96853d1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:59.650634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 118/233] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:41:59 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:41:59.659186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbdd95-d856-4cf3-ba12-3fc29b4ab4fc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:41:59.767437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbdd95-d856-4cf3-ba12-3fc29b4ab4fc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:41:59.797950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:41:59.803676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32940-6e83-4cc3-b2af-de5844a0c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:41:59.804586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32940-6e83-4cc3-b2af-de5844a0c4a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:41:59.805077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32940-6e83-4cc3-b2af-de5844a0c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:41:59.805356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32940-6e83-4cc3-b2af-de5844a0c4a1 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd/users/ac73bbdf8c4140b9b613669613c3b5b7/roles/23dcaf1f585d4a03a6101a69a6bdd9f1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:41:59.807625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca32940-6e83-4cc3-b2af-de5844a0c4a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc98143553e408eab2fd06c84a65bdd, user_id=ac73bbdf8c4140b9b613669613c3b5b7, role_id=23dcaf1f585d4a03a6101a69a6bdd9f1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:41:59.809054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca32940-6e83-4cc3-b2af-de5844a0c4a1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:41:59.950602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 116/234] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:41:59 2022] PUT /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd/users/ac73bbdf8c4140b9b613669613c3b5b7/roles/23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:01.712510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6da00-3f71-4ce6-9068-d36d899cd19d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.713501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6da00-3f71-4ce6-9068-d36d899cd19d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.713995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6da00-3f71-4ce6-9068-d36d899cd19d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.715868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 119/235] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:01.721531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd5549-4be9-4ffd-b889-b73c91c0c40b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.722374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd5549-4be9-4ffd-b889-b73c91c0c40b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.722868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd5549-4be9-4ffd-b889-b73c91c0c40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.740907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-84fd5549-4be9-4ffd-b889-b73c91c0c40b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:01.742425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-84fd5549-4be9-4ffd-b889-b73c91c0c40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:01.795844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9ed43-5124-443d-844c-bc2220f4795e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.796154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9ed43-5124-443d-844c-bc2220f4795e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.796496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9ed43-5124-443d-844c-bc2220f4795e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.802078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 120/236] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:01.803672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab412f-7dbc-44d2-bd06-89bcfccef5d9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.803963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab412f-7dbc-44d2-bd06-89bcfccef5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.804244 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab412f-7dbc-44d2-bd06-89bcfccef5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.822012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7aab412f-7dbc-44d2-bd06-89bcfccef5d9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:01.823261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7aab412f-7dbc-44d2-bd06-89bcfccef5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:01.834906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 117/237] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:01.842095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970780b-489c-46a6-b91f-09754fff0570 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.842095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970780b-489c-46a6-b91f-09754fff0570 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.842095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970780b-489c-46a6-b91f-09754fff0570 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.842764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 118/238] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:01.848586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402704c8-a286-4c0f-bf1e-1264c1c92d22 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:01.848916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402704c8-a286-4c0f-bf1e-1264c1c92d22 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:01.849258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402704c8-a286-4c0f-bf1e-1264c1c92d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:01.867137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-402704c8-a286-4c0f-bf1e-1264c1c92d22 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:01.868646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-402704c8-a286-4c0f-bf1e-1264c1c92d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:01.912136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 121/239] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:01.913310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab412f-7dbc-44d2-bd06-89bcfccef5d9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:01.941684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 119/240] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:01.956947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402704c8-a286-4c0f-bf1e-1264c1c92d22 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:01.980513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:02.011656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:02.028787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab412f-7dbc-44d2-bd06-89bcfccef5d9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.065770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402704c8-a286-4c0f-bf1e-1264c1c92d22 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.066984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197df1-35cb-46d6-96c8-77343e4073bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.067860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197df1-35cb-46d6-96c8-77343e4073bd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.068151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197df1-35cb-46d6-96c8-77343e4073bd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.068430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31197df1-35cb-46d6-96c8-77343e4073bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.080614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31197df1-35cb-46d6-96c8-77343e4073bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-31197df1-35cb-46d6-96c8-77343e4073bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:02.088366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:02.089236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:02.090010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 122/241] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:02.090757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197df1-35cb-46d6-96c8-77343e4073bd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:02.106253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a42df-0a68-4929-9412-f5f53704713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.107317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a42df-0a68-4929-9412-f5f53704713a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.107981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a42df-0a68-4929-9412-f5f53704713a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.108265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a42df-0a68-4929-9412-f5f53704713a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.110495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a42df-0a68-4929-9412-f5f53704713a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:02.112418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a42df-0a68-4929-9412-f5f53704713a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:02.118529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 120/242] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:02.118529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baca4a-2857-48f4-b7f3-6750d9a22f4b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.118529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baca4a-2857-48f4-b7f3-6750d9a22f4b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.118529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27baca4a-2857-48f4-b7f3-6750d9a22f4b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.120297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 121/243] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:02.120297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27baca4a-2857-48f4-b7f3-6750d9a22f4b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:02.196609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31197df1-35cb-46d6-96c8-77343e4073bd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.213845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:02.232640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a4592-cea0-4a1b-8e45-e13ce49cea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.233411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a4592-cea0-4a1b-8e45-e13ce49cea8a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.233697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a4592-cea0-4a1b-8e45-e13ce49cea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.234854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a4592-cea0-4a1b-8e45-e13ce49cea8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.242324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27baca4a-2857-48f4-b7f3-6750d9a22f4b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.246132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a4592-cea0-4a1b-8e45-e13ce49cea8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1d3a4592-cea0-4a1b-8e45-e13ce49cea8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:02.255473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:02.256372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:02.257169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 123/244] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:02.262197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a4592-cea0-4a1b-8e45-e13ce49cea8a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:02.262686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:02.283390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd509-8955-456c-b1de-59f715698565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.284058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd509-8955-456c-b1de-59f715698565 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.284339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd509-8955-456c-b1de-59f715698565 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.284611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd509-8955-456c-b1de-59f715698565 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.285365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdd509-8955-456c-b1de-59f715698565 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:02.285669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdd509-8955-456c-b1de-59f715698565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:02.287076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdd509-8955-456c-b1de-59f715698565 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:02.300598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 122/245] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:02.300598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51871d-7e26-4205-b1de-a7400583f5c9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.300598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51871d-7e26-4205-b1de-a7400583f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.300598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51871d-7e26-4205-b1de-a7400583f5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.317726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1b51871d-7e26-4205-b1de-a7400583f5c9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:02.318937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1b51871d-7e26-4205-b1de-a7400583f5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:02.373855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a4592-cea0-4a1b-8e45-e13ce49cea8a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.388648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 123/246] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:02.394997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51871d-7e26-4205-b1de-a7400583f5c9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:02.412625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e57413-2dfb-46b0-8fd7-2e370dcec8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.413298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e57413-2dfb-46b0-8fd7-2e370dcec8c9 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.413583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e57413-2dfb-46b0-8fd7-2e370dcec8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.413859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e57413-2dfb-46b0-8fd7-2e370dcec8c9 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.414608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e57413-2dfb-46b0-8fd7-2e370dcec8c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:02.416037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e57413-2dfb-46b0-8fd7-2e370dcec8c9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:02.501242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51871d-7e26-4205-b1de-a7400583f5c9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.511908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:02.535042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.535704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.535988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.536262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.537295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:02.538468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:02.539895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:02.545452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 124/247] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:42:02 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:02.546368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e57413-2dfb-46b0-8fd7-2e370dcec8c9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:02.549285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 124/248] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:02.550409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:02.589880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:02.670286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e57413-2dfb-46b0-8fd7-2e370dcec8c9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.670490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27c9d5-85cb-4355-bb15-f8c23ecc8cc7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.707932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b939d08-6f1b-4231-9595-617895151880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.708731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939d08-6f1b-4231-9595-617895151880 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.709022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939d08-6f1b-4231-9595-617895151880 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.709301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939d08-6f1b-4231-9595-617895151880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.713639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae4fa-8924-4acc-b94d-8a22d7c09cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.714833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae4fa-8924-4acc-b94d-8a22d7c09cdf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.715119 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae4fa-8924-4acc-b94d-8a22d7c09cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.715394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ae4fa-8924-4acc-b94d-8a22d7c09cdf None admin] PATH_INFO: `/v3/users/0bbfacfac9984450910d81f2a640769c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.721344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b939d08-6f1b-4231-9595-617895151880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-1b939d08-6f1b-4231-9595-617895151880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:02.729147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:02.732578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 125/249] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:02.733358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9fa9-8f36-4244-b662-39ab6cdb0ede None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.734696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9fa9-8f36-4244-b662-39ab6cdb0ede None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.734696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9fa9-8f36-4244-b662-39ab6cdb0ede None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.734696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 126/250] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:02.734861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9fa9-8f36-4244-b662-39ab6cdb0ede None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:02.766525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ae4fa-8924-4acc-b94d-8a22d7c09cdf None admin] RBAC: Authorizing `identity:get_user(user_id=0bbfacfac9984450910d81f2a640769c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:02.766525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ae4fa-8924-4acc-b94d-8a22d7c09cdf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:02.766525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 125/251] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/users/0bbfacfac9984450910d81f2a640769c => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:02.766525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae4fa-8924-4acc-b94d-8a22d7c09cdf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:02.780382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:02.876166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9fa9-8f36-4244-b662-39ab6cdb0ede None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.890022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:02.903344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ae4fa-8924-4acc-b94d-8a22d7c09cdf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:02.921634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b55ce-972d-45f8-ae5f-1d541330af7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.923173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b55ce-972d-45f8-ae5f-1d541330af7c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.924025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b55ce-972d-45f8-ae5f-1d541330af7c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.924624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b55ce-972d-45f8-ae5f-1d541330af7c None admin] PATH_INFO: `/v3/users/250e1e8e5a814bcb814f8fcb41bde905` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.926690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b55ce-972d-45f8-ae5f-1d541330af7c None admin] RBAC: Authorizing `identity:get_user(user_id=250e1e8e5a814bcb814f8fcb41bde905)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:02.929210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b55ce-972d-45f8-ae5f-1d541330af7c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:02.931094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 127/252] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/users/250e1e8e5a814bcb814f8fcb41bde905 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:02.933277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30238480-c0d4-4cd9-9636-ad5f76cc730e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30238480-c0d4-4cd9-9636-ad5f76cc730e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.938867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30238480-c0d4-4cd9-9636-ad5f76cc730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.953917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:02.954989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:02.955471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:02.955942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:02.956951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:02.957465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:02.959146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:02.960377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-30238480-c0d4-4cd9-9636-ad5f76cc730e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:02.961641 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-30238480-c0d4-4cd9-9636-ad5f76cc730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:02.969563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 126/253] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:02.970727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.036320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 128/254] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:03.042329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30238480-c0d4-4cd9-9636-ad5f76cc730e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.086798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:03.087680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45997-ecf5-4742-99d1-537388907439 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.123435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42642d8-9c39-4f3d-8044-6fa66d7bca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.124932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42642d8-9c39-4f3d-8044-6fa66d7bca24 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.125498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42642d8-9c39-4f3d-8044-6fa66d7bca24 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.125954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42642d8-9c39-4f3d-8044-6fa66d7bca24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.149907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:03.161966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30238480-c0d4-4cd9-9636-ad5f76cc730e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.201545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647cf8d-6aea-4118-837d-1aa6e4180737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.202458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647cf8d-6aea-4118-837d-1aa6e4180737 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.202774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647cf8d-6aea-4118-837d-1aa6e4180737 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.203055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647cf8d-6aea-4118-837d-1aa6e4180737 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.204380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42642d8-9c39-4f3d-8044-6fa66d7bca24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:03.204537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647cf8d-6aea-4118-837d-1aa6e4180737 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:03.205993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647cf8d-6aea-4118-837d-1aa6e4180737 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:03.206432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42642d8-9c39-4f3d-8044-6fa66d7bca24 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:03.212217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 129/255] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:03 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:03.212217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647cf8d-6aea-4118-837d-1aa6e4180737 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.333770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 127/256] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:03.335248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42642d8-9c39-4f3d-8044-6fa66d7bca24 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.335944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:03.340011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647cf8d-6aea-4118-837d-1aa6e4180737 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.376327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f024-1b7c-4472-a806-981205db03df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.377210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f024-1b7c-4472-a806-981205db03df None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.377872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f024-1b7c-4472-a806-981205db03df None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.378251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f024-1b7c-4472-a806-981205db03df None admin] PATH_INFO: `/v3/users/ac73bbdf8c4140b9b613669613c3b5b7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.380074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23f024-1b7c-4472-a806-981205db03df None admin] RBAC: Authorizing `identity:get_user(user_id=ac73bbdf8c4140b9b613669613c3b5b7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:03.381595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23f024-1b7c-4472-a806-981205db03df None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:03.388058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 130/257] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:03 2022] GET /identity/v3/users/ac73bbdf8c4140b9b613669613c3b5b7 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:03.389016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f024-1b7c-4472-a806-981205db03df None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.411735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:03.478096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42642d8-9c39-4f3d-8044-6fa66d7bca24 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.499132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f024-1b7c-4472-a806-981205db03df None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.525112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690bfa3-fec5-4564-8872-f77d9cbb8cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.526404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690bfa3-fec5-4564-8872-f77d9cbb8cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.527103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690bfa3-fec5-4564-8872-f77d9cbb8cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.527909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690bfa3-fec5-4564-8872-f77d9cbb8cc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.535691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311c46d-ae9a-460b-a1e0-b011e9d91c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.536710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311c46d-ae9a-460b-a1e0-b011e9d91c0b None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.537086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311c46d-ae9a-460b-a1e0-b011e9d91c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.537460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311c46d-ae9a-460b-a1e0-b011e9d91c0b None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd/users/250e1e8e5a814bcb814f8fcb41bde905/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.539569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311c46d-ae9a-460b-a1e0-b011e9d91c0b None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc98143553e408eab2fd06c84a65bdd, user_id=250e1e8e5a814bcb814f8fcb41bde905, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:03.541200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311c46d-ae9a-460b-a1e0-b011e9d91c0b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:03.541444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690bfa3-fec5-4564-8872-f77d9cbb8cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0690bfa3-fec5-4564-8872-f77d9cbb8cc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:03.551351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:03.552258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:03.553063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 128/258] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:42:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:03.553697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690bfa3-fec5-4564-8872-f77d9cbb8cc3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.612435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 131/259] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:42:03 2022] PUT /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd/users/250e1e8e5a814bcb814f8fcb41bde905/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:03.613629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311c46d-ae9a-460b-a1e0-b011e9d91c0b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.674566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:03.733584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690bfa3-fec5-4564-8872-f77d9cbb8cc3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.757831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:03.804047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcd4cc-cbcc-457c-afdf-eca5168b3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.804988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd4cc-cbcc-457c-afdf-eca5168b3f4b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.805274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd4cc-cbcc-457c-afdf-eca5168b3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.805551 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fcd4cc-cbcc-457c-afdf-eca5168b3f4b None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.806951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcd4cc-cbcc-457c-afdf-eca5168b3f4b None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:03.808422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fcd4cc-cbcc-457c-afdf-eca5168b3f4b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:03.810384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 129/260] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:03 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:03.813358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcd4cc-cbcc-457c-afdf-eca5168b3f4b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:03.831697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311c46d-ae9a-460b-a1e0-b011e9d91c0b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.884942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5884-80ba-4879-a21e-0b1e573f0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.885925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5884-80ba-4879-a21e-0b1e573f0c5f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.886537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5884-80ba-4879-a21e-0b1e573f0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.887079 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5884-80ba-4879-a21e-0b1e573f0c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.945535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fcd4cc-cbcc-457c-afdf-eca5168b3f4b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:03.963719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c5884-80ba-4879-a21e-0b1e573f0c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:03.965505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c5884-80ba-4879-a21e-0b1e573f0c5f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:03.981420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:03.982104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:03.982394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:03.982672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:03.983537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:03.983881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:03.985237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:03.995048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 130/261] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:03.995868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:04.000342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:04.040837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:04.082541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 132/262] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:04.083738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5884-80ba-4879-a21e-0b1e573f0c5f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:04.122756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05816-faa4-4092-87af-07becfb78ca1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:04.189973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5884-80ba-4879-a21e-0b1e573f0c5f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:04.219613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:04.220288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:04.220577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:04.220859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:04.221710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] RBAC: Adding query filter params (role.id=6d9f69d95e3246a1b656c43e5966fbc6, scope.project.id=bfc98143553e408eab2fd06c84a65bdd, user.id=0bbfacfac9984450910d81f2a640769c) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:04.222113 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:04.222505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:04.223578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:04.231328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce47ad-b9d2-4120-9d7d-f3cc83d14295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:04.232525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce47ad-b9d2-4120-9d7d-f3cc83d14295 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:04.233231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce47ad-b9d2-4120-9d7d-f3cc83d14295 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:04.235023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce47ad-b9d2-4120-9d7d-f3cc83d14295 None admin] PATH_INFO: `/v3/users/ac73bbdf8c4140b9b613669613c3b5b7` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:04.236689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce47ad-b9d2-4120-9d7d-f3cc83d14295 None admin] RBAC: Authorizing `identity:get_user(user_id=ac73bbdf8c4140b9b613669613c3b5b7)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:04.239668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce47ad-b9d2-4120-9d7d-f3cc83d14295 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:04.240752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 131/263] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:03 2022] GET /identity/v3/role_assignments?user.id=0bbfacfac9984450910d81f2a640769c&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=6d9f69d95e3246a1b656c43e5966fbc6 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:04.241748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:04.248809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 133/264] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:04 2022] GET /identity/v3/users/ac73bbdf8c4140b9b613669613c3b5b7 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:04.251193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce47ad-b9d2-4120-9d7d-f3cc83d14295 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:04.380904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce47ad-b9d2-4120-9d7d-f3cc83d14295 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:04.418903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9183-8fa8-45a4-973e-83858d7fdaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:04.419985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9183-8fa8-45a4-973e-83858d7fdaff None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:04.420491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9183-8fa8-45a4-973e-83858d7fdaff None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:04.420963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9183-8fa8-45a4-973e-83858d7fdaff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:04.447874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ce658-d027-4352-97c2-616d951ed47b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:04.455800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:04.506417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:04.506605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34b12-c031-46dc-94a1-0c5a7d5f9f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:04.507307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34b12-c031-46dc-94a1-0c5a7d5f9f89 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:04.507595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34b12-c031-46dc-94a1-0c5a7d5f9f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:04.507873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34b12-c031-46dc-94a1-0c5a7d5f9f89 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:04.509194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a34b12-c031-46dc-94a1-0c5a7d5f9f89 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:04.518554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a34b12-c031-46dc-94a1-0c5a7d5f9f89 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:04.521956 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 132/265] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:04 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:04.526219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34b12-c031-46dc-94a1-0c5a7d5f9f89 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:04.527348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e9183-8fa8-45a4-973e-83858d7fdaff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:04.528825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e9183-8fa8-45a4-973e-83858d7fdaff None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:04.736616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34b12-c031-46dc-94a1-0c5a7d5f9f89 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:04.770308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 134/266] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:04.771696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9183-8fa8-45a4-973e-83858d7fdaff None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:04.849824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:04.850508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:04.850794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:04.851070 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:04.851918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=bfc98143553e408eab2fd06c84a65bdd, user.id=ac73bbdf8c4140b9b613669613c3b5b7) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:04.852228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:04.853664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:04.882106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 133/267] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:04 2022] GET /identity/v3/role_assignments?user.id=ac73bbdf8c4140b9b613669613c3b5b7&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 608 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:04.923498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9183-8fa8-45a4-973e-83858d7fdaff None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:04.954449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:04.963883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904bd61-9c03-465c-8a74-18b0e8d8eb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:04.965076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904bd61-9c03-465c-8a74-18b0e8d8eb0b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:04.965591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904bd61-9c03-465c-8a74-18b0e8d8eb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:04.966116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904bd61-9c03-465c-8a74-18b0e8d8eb0b None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:04.967506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904bd61-9c03-465c-8a74-18b0e8d8eb0b None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:04.969782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904bd61-9c03-465c-8a74-18b0e8d8eb0b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:04.971739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 135/268] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:04 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:04.977988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:05.014376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce10ef-aa04-4b85-ac23-39d7b7ea20e9 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.015861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce10ef-aa04-4b85-ac23-39d7b7ea20e9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.016341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce10ef-aa04-4b85-ac23-39d7b7ea20e9 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.019957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 136/269] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:42:05.042130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:05.047640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b2010-9040-46c2-813c-fca48dfc799c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.048210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b2010-9040-46c2-813c-fca48dfc799c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.048689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b2010-9040-46c2-813c-fca48dfc799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.075155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c52b2010-9040-46c2-813c-fca48dfc799c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:05.076450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c52b2010-9040-46c2-813c-fca48dfc799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:05.107428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69470332-e936-4c81-a87d-8e57b5983837 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:05.147689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3042f-e484-497b-960a-f0348a20192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:05.148354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3042f-e484-497b-960a-f0348a20192f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.148640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3042f-e484-497b-960a-f0348a20192f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.148920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3042f-e484-497b-960a-f0348a20192f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.149781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3042f-e484-497b-960a-f0348a20192f None admin] RBAC: Adding query filter params (role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=bfc98143553e408eab2fd06c84a65bdd, user.id=ac73bbdf8c4140b9b613669613c3b5b7) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:05.150166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3042f-e484-497b-960a-f0348a20192f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:05.151612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3042f-e484-497b-960a-f0348a20192f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:05.162848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 134/270] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:04 2022] GET /identity/v3/role_assignments?user.id=ac73bbdf8c4140b9b613669613c3b5b7&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:05.163624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c767-56b2-43f5-83c9-7095f88ad9c2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.163918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c767-56b2-43f5-83c9-7095f88ad9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.164201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c767-56b2-43f5-83c9-7095f88ad9c2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.165689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 135/271] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:05.172444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79112c-17fe-4ff1-9de2-1092fb47f895 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.172884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79112c-17fe-4ff1-9de2-1092fb47f895 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.173173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79112c-17fe-4ff1-9de2-1092fb47f895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.202096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 137/272] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:05.219271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cd79112c-17fe-4ff1-9de2-1092fb47f895 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:05.220601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cd79112c-17fe-4ff1-9de2-1092fb47f895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:05.275439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b2010-9040-46c2-813c-fca48dfc799c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:05.314293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 136/273] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:05.360837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79112c-17fe-4ff1-9de2-1092fb47f895 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:05.412331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:05.428436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:05.436771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b2010-9040-46c2-813c-fca48dfc799c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:05.484350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e36f11-747e-438e-8430-281a35299f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:05.485478 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e36f11-747e-438e-8430-281a35299f3b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.485770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e36f11-747e-438e-8430-281a35299f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.486174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e36f11-747e-438e-8430-281a35299f3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.503848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e36f11-747e-438e-8430-281a35299f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c2e36f11-747e-438e-8430-281a35299f3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:05.511809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:05.512688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:05.513927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 138/274] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:05.517649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79112c-17fe-4ff1-9de2-1092fb47f895 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:05.519471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e36f11-747e-438e-8430-281a35299f3b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:05.566729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726ae0e-25c8-4014-b2f9-03c5452e4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:05.567893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ae0e-25c8-4014-b2f9-03c5452e4c7e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.568377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ae0e-25c8-4014-b2f9-03c5452e4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.569308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726ae0e-25c8-4014-b2f9-03c5452e4c7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.571269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726ae0e-25c8-4014-b2f9-03c5452e4c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:05.573246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726ae0e-25c8-4014-b2f9-03c5452e4c7e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:05.575715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 137/275] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:05.583713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726ae0e-25c8-4014-b2f9-03c5452e4c7e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:05.634513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e36f11-747e-438e-8430-281a35299f3b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:05.670877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:05.672100 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.672466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.672739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.673549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:05.673858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:05.675798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:05.684802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 139/276] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:05.691173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:05.697718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:05.701107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726ae0e-25c8-4014-b2f9-03c5452e4c7e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:05.710272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:05.741294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49118a-aafd-48b6-b19a-70533ba928ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:05.742813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49118a-aafd-48b6-b19a-70533ba928ba None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.743302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49118a-aafd-48b6-b19a-70533ba928ba None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.743773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49118a-aafd-48b6-b19a-70533ba928ba None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.744693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49118a-aafd-48b6-b19a-70533ba928ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:05.746398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49118a-aafd-48b6-b19a-70533ba928ba None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:05.799281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748e323-e703-4fc3-9976-4ef3ac3af6e0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:05.839154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 138/277] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:42:05 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:05.845386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a763c6-fe77-49bf-bf79-66c51daf6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:05.846580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a763c6-fe77-49bf-bf79-66c51daf6485 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:05.847040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a763c6-fe77-49bf-bf79-66c51daf6485 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:05.847500 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a763c6-fe77-49bf-bf79-66c51daf6485 None admin] PATH_INFO: `/v3/users/7404b1db45f6439db09e7f4f055cdad1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:05.865444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a763c6-fe77-49bf-bf79-66c51daf6485 None admin] RBAC: Authorizing `identity:get_user(user_id=7404b1db45f6439db09e7f4f055cdad1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:05.867231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a763c6-fe77-49bf-bf79-66c51daf6485 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:05.869274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 140/278] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:05 2022] GET /identity/v3/users/7404b1db45f6439db09e7f4f055cdad1 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:05.876187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49118a-aafd-48b6-b19a-70533ba928ba None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:05.994173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49118a-aafd-48b6-b19a-70533ba928ba None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:06.029562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42801afb-6790-4962-990f-39d19dd945b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:06.030264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801afb-6790-4962-990f-39d19dd945b4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.030552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801afb-6790-4962-990f-39d19dd945b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.031762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42801afb-6790-4962-990f-39d19dd945b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.032603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42801afb-6790-4962-990f-39d19dd945b4 None admin] RBAC: Adding query filter params (role.id=d9de94a33cd64dc88a723f03480c9e17, user.id=7404b1db45f6439db09e7f4f055cdad1, scope.system=all) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:06.032915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42801afb-6790-4962-990f-39d19dd945b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:06.034436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42801afb-6790-4962-990f-39d19dd945b4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:06.040204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 139/279] 10.222.0.36 () {56 vars in 1308 bytes} [Wed Jun 22 08:42:05 2022] GET /identity/v3/role_assignments?user.id=7404b1db45f6439db09e7f4f055cdad1&scope.system=all&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:06.422934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e0bb9-a6af-4ff7-b1f0-c4ee6465d79c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.423451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e0bb9-a6af-4ff7-b1f0-c4ee6465d79c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.423530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e0bb9-a6af-4ff7-b1f0-c4ee6465d79c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.425119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 141/280] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:06.430449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c88f-371e-488f-b4f3-9740577fdcb9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.430745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c88f-371e-488f-b4f3-9740577fdcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.431031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c88f-371e-488f-b4f3-9740577fdcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.455194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7f52c88f-371e-488f-b4f3-9740577fdcb9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:06.456395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7f52c88f-371e-488f-b4f3-9740577fdcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:06.480996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:06.549711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 140/281] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:06.583646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e0bb9-a6af-4ff7-b1f0-c4ee6465d79c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:06.674003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:06.712119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e0bb9-a6af-4ff7-b1f0-c4ee6465d79c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:06.762786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c7186-cfc6-40f9-a820-91156b25f81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:06.763597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7186-cfc6-40f9-a820-91156b25f81e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.763886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7186-cfc6-40f9-a820-91156b25f81e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.764166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c7186-cfc6-40f9-a820-91156b25f81e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.779061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c7186-cfc6-40f9-a820-91156b25f81e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-059c7186-cfc6-40f9-a820-91156b25f81e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:06.788943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:06.789847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:06.790645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:06.794250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 142/282] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:06.800891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c88f-371e-488f-b4f3-9740577fdcb9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:06.891871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889cd86-9862-4e52-84a9-f5061480c347 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.892485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889cd86-9862-4e52-84a9-f5061480c347 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.892987 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889cd86-9862-4e52-84a9-f5061480c347 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.894843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 143/283] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:42:06.899863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc59ce-63e3-4035-a5a2-f9169a4e74e8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:06.900358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc59ce-63e3-4035-a5a2-f9169a4e74e8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:06.900829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc59ce-63e3-4035-a5a2-f9169a4e74e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:06.917903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7edc59ce-63e3-4035-a5a2-f9169a4e74e8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:06.919412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7edc59ce-63e3-4035-a5a2-f9169a4e74e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:06.955404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c88f-371e-488f-b4f3-9740577fdcb9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:07.020583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:07.021605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:07.022142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:07.023663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:07.024714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:07.025900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:07.028179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:07.038446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 144/284] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:07.046975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 141/285] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:07.052040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc59ce-63e3-4035-a5a2-f9169a4e74e8 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:07.103711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:07.120182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:07.145350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:07.223918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc59ce-63e3-4035-a5a2-f9169a4e74e8 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:07.271585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4064a0-3d77-4c70-990c-1b9e472d6cc2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:07.299634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b899-c229-4934-bdc5-ece3d8be4daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:07.300526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b899-c229-4934-bdc5-ece3d8be4daf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:07.300807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b899-c229-4934-bdc5-ece3d8be4daf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:07.301084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b899-c229-4934-bdc5-ece3d8be4daf None admin] PATH_INFO: `/v3/users/250e1e8e5a814bcb814f8fcb41bde905` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:07.302352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281b899-c229-4934-bdc5-ece3d8be4daf None admin] RBAC: Authorizing `identity:get_user(user_id=250e1e8e5a814bcb814f8fcb41bde905)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:07.303771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281b899-c229-4934-bdc5-ece3d8be4daf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:07.305812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 145/286] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:07 2022] GET /identity/v3/users/250e1e8e5a814bcb814f8fcb41bde905 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:07.311102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b899-c229-4934-bdc5-ece3d8be4daf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:07.315409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a112b-953d-4af1-a012-cd5cc1655027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:07.316217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a112b-953d-4af1-a012-cd5cc1655027 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:07.316560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a112b-953d-4af1-a012-cd5cc1655027 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:07.316837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a112b-953d-4af1-a012-cd5cc1655027 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:07.346964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a112b-953d-4af1-a012-cd5cc1655027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-850a112b-953d-4af1-a012-cd5cc1655027 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:07.362765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:07.363644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:07.364444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 142/287] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:07.369640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a112b-953d-4af1-a012-cd5cc1655027 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:07.436425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b899-c229-4934-bdc5-ece3d8be4daf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:07.489729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:07.491610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:07.515193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f5bd-f9d1-4ae0-8745-c4f2afaffacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:07.516114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f5bd-f9d1-4ae0-8745-c4f2afaffacf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:07.516400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f5bd-f9d1-4ae0-8745-c4f2afaffacf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:07.516671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f5bd-f9d1-4ae0-8745-c4f2afaffacf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:07.525305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a112b-953d-4af1-a012-cd5cc1655027 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:07.564735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:07.566358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:07.566646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:07.566921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:07.567676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:07.567980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:07.569676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:07.579610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 143/288] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:07.585289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:07.707395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123f5bd-f9d1-4ae0-8745-c4f2afaffacf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:07.708853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123f5bd-f9d1-4ae0-8745-c4f2afaffacf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:07.799950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4cf8-a229-4a76-9edf-696bfab6223d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:07.846842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189437-83df-4d8e-998a-b8ed8ffd6977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:07.847725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189437-83df-4d8e-998a-b8ed8ffd6977 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:07.848005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189437-83df-4d8e-998a-b8ed8ffd6977 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:07.848273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2189437-83df-4d8e-998a-b8ed8ffd6977 None admin] PATH_INFO: `/v3/users/0bbfacfac9984450910d81f2a640769c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:07.849620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2189437-83df-4d8e-998a-b8ed8ffd6977 None admin] RBAC: Authorizing `identity:get_user(user_id=0bbfacfac9984450910d81f2a640769c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:07.851086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2189437-83df-4d8e-998a-b8ed8ffd6977 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:07.852718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 144/289] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:07 2022] GET /identity/v3/users/0bbfacfac9984450910d81f2a640769c => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:07.861941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189437-83df-4d8e-998a-b8ed8ffd6977 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:07.866722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:07.941269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 146/290] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 08:42:07.963542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f5bd-f9d1-4ae0-8745-c4f2afaffacf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:08.018427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:08.041072 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2189437-83df-4d8e-998a-b8ed8ffd6977 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:08.108146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aee44-7ce0-458c-bdf2-c9c19d0bf7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:08.110052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aee44-7ce0-458c-bdf2-c9c19d0bf7bf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.112028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aee44-7ce0-458c-bdf2-c9c19d0bf7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.113300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aee44-7ce0-458c-bdf2-c9c19d0bf7bf None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.115611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0aee44-7ce0-458c-bdf2-c9c19d0bf7bf None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:08.117421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0aee44-7ce0-458c-bdf2-c9c19d0bf7bf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:08.121708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 145/291] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:07 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:08.126529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aee44-7ce0-458c-bdf2-c9c19d0bf7bf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:08.148954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f5bd-f9d1-4ae0-8745-c4f2afaffacf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:08.202946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:08.233578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aee44-7ce0-458c-bdf2-c9c19d0bf7bf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:08.270572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811814d-9c33-472e-bb15-cc1658bb89c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:08.271898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811814d-9c33-472e-bb15-cc1658bb89c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.272383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811814d-9c33-472e-bb15-cc1658bb89c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.272892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811814d-9c33-472e-bb15-cc1658bb89c3 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd/users/0bbfacfac9984450910d81f2a640769c/roles/6d9f69d95e3246a1b656c43e5966fbc6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.274769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf7742-4ab6-4413-b224-00916249c4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:08.275351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811814d-9c33-472e-bb15-cc1658bb89c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc98143553e408eab2fd06c84a65bdd, user_id=0bbfacfac9984450910d81f2a640769c, role_id=6d9f69d95e3246a1b656c43e5966fbc6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:08.275642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7742-4ab6-4413-b224-00916249c4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.275928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7742-4ab6-4413-b224-00916249c4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.276206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf7742-4ab6-4413-b224-00916249c4b8 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.277436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf7742-4ab6-4413-b224-00916249c4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:08.277929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811814d-9c33-472e-bb15-cc1658bb89c3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:08.278898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf7742-4ab6-4413-b224-00916249c4b8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:08.281162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 147/292] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:07 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:08.288870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf7742-4ab6-4413-b224-00916249c4b8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:08.355042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 146/293] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:42:08 2022] PUT /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd/users/0bbfacfac9984450910d81f2a640769c/roles/6d9f69d95e3246a1b656c43e5966fbc6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 08:42:08.356728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cf47-d846-4029-9d1e-ee4a392abef6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.357218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cf47-d846-4029-9d1e-ee4a392abef6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.357771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1cf47-d846-4029-9d1e-ee4a392abef6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.359448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 147/294] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:08.368049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4a472-189d-4cbc-bba0-ced7dcb895ff None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.368940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4a472-189d-4cbc-bba0-ced7dcb895ff None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.370896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4a472-189d-4cbc-bba0-ced7dcb895ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.408589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-62e4a472-189d-4cbc-bba0-ced7dcb895ff None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:08.409815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-62e4a472-189d-4cbc-bba0-ced7dcb895ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:08.447475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:08.457337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf7742-4ab6-4413-b224-00916249c4b8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:08.528182 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af854ee-5f2f-49b8-a122-fa191555578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:08.529257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af854ee-5f2f-49b8-a122-fa191555578a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.529764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af854ee-5f2f-49b8-a122-fa191555578a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.530258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af854ee-5f2f-49b8-a122-fa191555578a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.531641 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af854ee-5f2f-49b8-a122-fa191555578a None admin] RBAC: Adding query filter params (role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=bfc98143553e408eab2fd06c84a65bdd, user.id=250e1e8e5a814bcb814f8fcb41bde905) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:08.532434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af854ee-5f2f-49b8-a122-fa191555578a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:08.539978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af854ee-5f2f-49b8-a122-fa191555578a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:08.547379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 148/295] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:08.549764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 148/296] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:08 2022] GET /identity/v3/role_assignments?user.id=250e1e8e5a814bcb814f8fcb41bde905&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:08.558528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa043-c9d8-4697-9451-e04fc3407d19 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.559090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa043-c9d8-4697-9451-e04fc3407d19 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.559544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa043-c9d8-4697-9451-e04fc3407d19 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.561198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 149/297] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:08.567903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d733e3-5624-45f3-aed0-edfca33664c1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.568196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d733e3-5624-45f3-aed0-edfca33664c1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.568481 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d733e3-5624-45f3-aed0-edfca33664c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.589390 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aa043-c9d8-4697-9451-e04fc3407d19 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:08.591501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b2d733e3-5624-45f3-aed0-edfca33664c1 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:08.592738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b2d733e3-5624-45f3-aed0-edfca33664c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:08.667559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:08.695306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 149/298] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:08.696939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6733c-7605-4f3c-bc08-91a06719d2af None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.697820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6733c-7605-4f3c-bc08-91a06719d2af None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.698757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6733c-7605-4f3c-bc08-91a06719d2af None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.700348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 150/299] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:08.706638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d48bd8-0104-4dea-849d-401a0515e5f5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.707215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d48bd8-0104-4dea-849d-401a0515e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.707507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d48bd8-0104-4dea-849d-401a0515e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.719818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aa043-c9d8-4697-9451-e04fc3407d19 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:08.729468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-05d48bd8-0104-4dea-849d-401a0515e5f5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:08.731753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-05d48bd8-0104-4dea-849d-401a0515e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:08.761055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dc9c6-0cfd-4c01-ae66-78e088cb084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:08.761892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dc9c6-0cfd-4c01-ae66-78e088cb084f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.762223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dc9c6-0cfd-4c01-ae66-78e088cb084f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.762498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dc9c6-0cfd-4c01-ae66-78e088cb084f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.765408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dc9c6-0cfd-4c01-ae66-78e088cb084f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:08.771051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dc9c6-0cfd-4c01-ae66-78e088cb084f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:08.771051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 150/300] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:08.771051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dc9c6-0cfd-4c01-ae66-78e088cb084f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:08.829364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 151/301] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:08.830293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d48bd8-0104-4dea-849d-401a0515e5f5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:08.862866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:08.898999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dc9c6-0cfd-4c01-ae66-78e088cb084f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:08.926488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:08.934078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa77b12-272b-47e4-8ab6-dba039db418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:08.934879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa77b12-272b-47e4-8ab6-dba039db418e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.935164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa77b12-272b-47e4-8ab6-dba039db418e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.935519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa77b12-272b-47e4-8ab6-dba039db418e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.946697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa77b12-272b-47e4-8ab6-dba039db418e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:08.947071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d48bd8-0104-4dea-849d-401a0515e5f5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8aa77b12-272b-47e4-8ab6-dba039db418e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:08.955144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:08.956011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:08.956810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 151/302] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:08.957452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa77b12-272b-47e4-8ab6-dba039db418e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:08.987826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf2dd1-b992-44ba-9360-4a0ca20b39b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:08.988492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2dd1-b992-44ba-9360-4a0ca20b39b0 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:08.988786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2dd1-b992-44ba-9360-4a0ca20b39b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:08.989111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2dd1-b992-44ba-9360-4a0ca20b39b0 None admin] PATH_INFO: `/v3/groups` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:08.989992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf2dd1-b992-44ba-9360-4a0ca20b39b0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:08.991199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf2dd1-b992-44ba-9360-4a0ca20b39b0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:09.071600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa77b12-272b-47e4-8ab6-dba039db418e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:09.092578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 152/303] 10.222.0.36 () {60 vars in 1134 bytes} [Wed Jun 22 08:42:08 2022] POST /identity/v3/groups => generated 229 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:09.093909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf2dd1-b992-44ba-9360-4a0ca20b39b0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:09.118702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4007d-06a8-4dc2-a301-7f1df704f099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:09.120416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4007d-06a8-4dc2-a301-7f1df704f099 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:09.120416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4007d-06a8-4dc2-a301-7f1df704f099 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:09.120579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4007d-06a8-4dc2-a301-7f1df704f099 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:09.134478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4007d-06a8-4dc2-a301-7f1df704f099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-59f4007d-06a8-4dc2-a301-7f1df704f099 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:09.144121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:09.145135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:09.145933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 152/304] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:09.151219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4007d-06a8-4dc2-a301-7f1df704f099 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:09.216158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:09.219595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:09.237061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf2dd1-b992-44ba-9360-4a0ca20b39b0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:09.282020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:09.282979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:09.283277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:09.283541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:09.284293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:09.284606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:09.285971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:09.293845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4007d-06a8-4dc2-a301-7f1df704f099 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:09.301521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 153/305] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:09.301837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:09.337472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:09.338230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:09.338522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:09.338807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:09.339565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:09.339878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:09.341259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:09.350990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 153/306] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:09.360010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:09.420806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7f95f-ec64-48b6-8d59-b1720575cfc2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:09.461368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb0288-6c25-413e-8e7a-90904d2c4382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:09.462286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0288-6c25-413e-8e7a-90904d2c4382 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:09.462558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0288-6c25-413e-8e7a-90904d2c4382 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:09.462833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb0288-6c25-413e-8e7a-90904d2c4382 None admin] PATH_INFO: `/v3/users/7404b1db45f6439db09e7f4f055cdad1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:09.464047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb0288-6c25-413e-8e7a-90904d2c4382 None admin] RBAC: Authorizing `identity:get_user(user_id=7404b1db45f6439db09e7f4f055cdad1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:09.466022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb0288-6c25-413e-8e7a-90904d2c4382 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:09.470174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 154/307] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:09 2022] GET /identity/v3/users/7404b1db45f6439db09e7f4f055cdad1 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:09.475125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb0288-6c25-413e-8e7a-90904d2c4382 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:09.496195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:09.497477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed51607-41c8-4015-8e2f-342e334cc767 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:09.509892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:09.535664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a99b-c198-4a43-a13b-1db14e64eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:09.536647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a99b-c198-4a43-a13b-1db14e64eef5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:09.536925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a99b-c198-4a43-a13b-1db14e64eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:09.537204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a99b-c198-4a43-a13b-1db14e64eef5 None admin] PATH_INFO: `/v3/users/89825aa5c1404ece98af1b65ea6b1b26` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:09.551822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a99b-c198-4a43-a13b-1db14e64eef5 None admin] RBAC: Authorizing `identity:get_user(user_id=89825aa5c1404ece98af1b65ea6b1b26)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:09.553286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a99b-c198-4a43-a13b-1db14e64eef5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:09.559871 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 154/308] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:09 2022] GET /identity/v3/users/89825aa5c1404ece98af1b65ea6b1b26 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:09.561738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a99b-c198-4a43-a13b-1db14e64eef5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:09.612155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb0288-6c25-413e-8e7a-90904d2c4382 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:09.652007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff85d50-a497-49cb-a64e-c5c212f6482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:09.652986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85d50-a497-49cb-a64e-c5c212f6482c None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:09.653247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85d50-a497-49cb-a64e-c5c212f6482c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:09.653566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85d50-a497-49cb-a64e-c5c212f6482c None admin] PATH_INFO: `/v3/system/users/7404b1db45f6439db09e7f4f055cdad1/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:09.655111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff85d50-a497-49cb-a64e-c5c212f6482c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7404b1db45f6439db09e7f4f055cdad1, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:09.657148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff85d50-a497-49cb-a64e-c5c212f6482c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:09.689787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a99b-c198-4a43-a13b-1db14e64eef5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:09.726565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c0bc2-ea11-4741-87fe-37b48d5d8340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:09.727554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c0bc2-ea11-4741-87fe-37b48d5d8340 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:09.728037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c0bc2-ea11-4741-87fe-37b48d5d8340 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:09.728507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c0bc2-ea11-4741-87fe-37b48d5d8340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:09.729577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c0bc2-ea11-4741-87fe-37b48d5d8340 None admin] RBAC: Adding query filter params (role.id=6d9f69d95e3246a1b656c43e5966fbc6, user.id=89825aa5c1404ece98af1b65ea6b1b26, scope.system=all) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:09.730137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c0bc2-ea11-4741-87fe-37b48d5d8340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:09.732683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c0bc2-ea11-4741-87fe-37b48d5d8340 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:09.746088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 155/309] 10.222.0.36 () {56 vars in 1308 bytes} [Wed Jun 22 08:42:09 2022] GET /identity/v3/role_assignments?user.id=89825aa5c1404ece98af1b65ea6b1b26&scope.system=all&role.id=6d9f69d95e3246a1b656c43e5966fbc6 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:09.750726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 155/310] 10.222.0.36 () {58 vars in 1334 bytes} [Wed Jun 22 08:42:09 2022] PUT /identity/v3/system/users/7404b1db45f6439db09e7f4f055cdad1/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:10.547415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8c102-655f-49c9-aaea-cb7541e0b249 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:10.548028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8c102-655f-49c9-aaea-cb7541e0b249 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:10.548028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8c102-655f-49c9-aaea-cb7541e0b249 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:10.549597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 156/311] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:10.554993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d102-2e21-41c4-86f4-cbf1f5c8c2b1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:10.555376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d102-2e21-41c4-86f4-cbf1f5c8c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:10.559455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a516d102-2e21-41c4-86f4-cbf1f5c8c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:10.572417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a516d102-2e21-41c4-86f4-cbf1f5c8c2b1 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:10.573609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a516d102-2e21-41c4-86f4-cbf1f5c8c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:10.643000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 156/312] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:10.666157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8c102-655f-49c9-aaea-cb7541e0b249 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:10.703388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:10.776991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8c102-655f-49c9-aaea-cb7541e0b249 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:10.813282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3442921-196f-4f99-b8d1-25616bf8f93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:10.814004 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3442921-196f-4f99-b8d1-25616bf8f93b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:10.814326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3442921-196f-4f99-b8d1-25616bf8f93b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:10.814604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3442921-196f-4f99-b8d1-25616bf8f93b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:10.825476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3442921-196f-4f99-b8d1-25616bf8f93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d3442921-196f-4f99-b8d1-25616bf8f93b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:10.834122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:10.835001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:10.835794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 157/313] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:10.843666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516d102-2e21-41c4-86f4-cbf1f5c8c2b1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:10.852152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:10.959196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a516d102-2e21-41c4-86f4-cbf1f5c8c2b1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:10.995824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:10.996495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:10.996783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:10.997120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:10.997874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:10.998264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:10.999960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:11.009653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 157/314] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:11.016325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3442921-196f-4f99-b8d1-25616bf8f93b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:11.120622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:11.130577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3442921-196f-4f99-b8d1-25616bf8f93b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:11.167726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caca428-0aad-4e8f-8be5-3913f90652f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:11.168598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caca428-0aad-4e8f-8be5-3913f90652f7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.168885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caca428-0aad-4e8f-8be5-3913f90652f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.169166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caca428-0aad-4e8f-8be5-3913f90652f7 None admin] PATH_INFO: `/v3/users/0bbfacfac9984450910d81f2a640769c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.170470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caca428-0aad-4e8f-8be5-3913f90652f7 None admin] RBAC: Authorizing `identity:get_user(user_id=0bbfacfac9984450910d81f2a640769c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:11.172398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caca428-0aad-4e8f-8be5-3913f90652f7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:11.174048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 158/315] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:11 2022] GET /identity/v3/users/0bbfacfac9984450910d81f2a640769c => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:11.179642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:11.252222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:11.289876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5947-780c-4a40-8b15-e282b1e98e16 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:11.291177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145c03-4470-475b-a5ca-25919498aeb6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.291474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145c03-4470-475b-a5ca-25919498aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.291759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145c03-4470-475b-a5ca-25919498aeb6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.293424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 159/316] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:11.298682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5495-c16e-4eb4-b716-79e2a3ad37c3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.298973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5495-c16e-4eb4-b716-79e2a3ad37c3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.299257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5495-c16e-4eb4-b716-79e2a3ad37c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.318457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-05fb5495-c16e-4eb4-b716-79e2a3ad37c3 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:11.319658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-05fb5495-c16e-4eb4-b716-79e2a3ad37c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:11.331326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae94d-a7c9-46b7-a679-31590eb153df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:11.332139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae94d-a7c9-46b7-a679-31590eb153df None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.332431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae94d-a7c9-46b7-a679-31590eb153df None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.332759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fae94d-a7c9-46b7-a679-31590eb153df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.395130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 160/317] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:11.417820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fae94d-a7c9-46b7-a679-31590eb153df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:11.419361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fae94d-a7c9-46b7-a679-31590eb153df None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:11.422564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5495-c16e-4eb4-b716-79e2a3ad37c3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:11.493765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:11.521585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:11.531625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5495-c16e-4eb4-b716-79e2a3ad37c3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:11.535848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 158/318] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:11.543682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae94d-a7c9-46b7-a679-31590eb153df None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:11.569202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e761f5-1f32-4d05-b72d-d82aee1b19c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:11.569997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e761f5-1f32-4d05-b72d-d82aee1b19c7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.570349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e761f5-1f32-4d05-b72d-d82aee1b19c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.570628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e761f5-1f32-4d05-b72d-d82aee1b19c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.571836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e761f5-1f32-4d05-b72d-d82aee1b19c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:11.573450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e761f5-1f32-4d05-b72d-d82aee1b19c7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:11.575544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 161/319] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:11.580885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e761f5-1f32-4d05-b72d-d82aee1b19c7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:11.668565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fae94d-a7c9-46b7-a679-31590eb153df None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:11.693255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e761f5-1f32-4d05-b72d-d82aee1b19c7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:11.708591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69fa24-4f68-4613-8cfb-4b97c446e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:11.709927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69fa24-4f68-4613-8cfb-4b97c446e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.710512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69fa24-4f68-4613-8cfb-4b97c446e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.710982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69fa24-4f68-4613-8cfb-4b97c446e9c8 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.712561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69fa24-4f68-4613-8cfb-4b97c446e9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:11.714138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69fa24-4f68-4613-8cfb-4b97c446e9c8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:11.716290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 159/320] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:11 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:11.722866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69fa24-4f68-4613-8cfb-4b97c446e9c8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:11.730853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b20bd-edbe-4dd3-98c8-9204279fba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:11.731527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b20bd-edbe-4dd3-98c8-9204279fba82 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.731816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b20bd-edbe-4dd3-98c8-9204279fba82 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.732096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b20bd-edbe-4dd3-98c8-9204279fba82 None admin] PATH_INFO: `/v3/groups` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.732793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b20bd-edbe-4dd3-98c8-9204279fba82 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:11.735197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b20bd-edbe-4dd3-98c8-9204279fba82 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:11.764790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:11.844156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69fa24-4f68-4613-8cfb-4b97c446e9c8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:11.852993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 162/321] 10.222.0.36 () {60 vars in 1134 bytes} [Wed Jun 22 08:42:11 2022] POST /identity/v3/groups => generated 226 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:42:11.854336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1cecf-4b62-4da1-a570-fb7b7fb366a9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.854630 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1cecf-4b62-4da1-a570-fb7b7fb366a9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.854923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1cecf-4b62-4da1-a570-fb7b7fb366a9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.856421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 163/322] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:11.864881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd470a-10fd-4fa3-abac-2df735c9773d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.865341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd470a-10fd-4fa3-abac-2df735c9773d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.865730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd470a-10fd-4fa3-abac-2df735c9773d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.887038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-97bd470a-10fd-4fa3-abac-2df735c9773d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:11.888703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-97bd470a-10fd-4fa3-abac-2df735c9773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:11.903315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485ccf0-26cd-48ad-920b-f27c7265c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:11.904086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ccf0-26cd-48ad-920b-f27c7265c198 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.904264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ccf0-26cd-48ad-920b-f27c7265c198 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.904537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485ccf0-26cd-48ad-920b-f27c7265c198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.906078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ccf0-26cd-48ad-920b-f27c7265c198 None admin] RBAC: Adding query filter params (role.id=6d9f69d95e3246a1b656c43e5966fbc6, scope.project.id=bfc98143553e408eab2fd06c84a65bdd, user.id=0bbfacfac9984450910d81f2a640769c) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:11.906472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ccf0-26cd-48ad-920b-f27c7265c198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:11.907943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485ccf0-26cd-48ad-920b-f27c7265c198 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:11.908930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:11.920213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 160/323] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:11 2022] GET /identity/v3/role_assignments?user.id=0bbfacfac9984450910d81f2a640769c&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=6d9f69d95e3246a1b656c43e5966fbc6 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:11.920213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc10e-6635-45a3-b381-e18a20cdc8c2 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.920213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc10e-6635-45a3-b381-e18a20cdc8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.920213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc10e-6635-45a3-b381-e18a20cdc8c2 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.920213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 161/324] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:11.924887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f763f1-0c77-487d-ab3e-63571202f698 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:11.925168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f763f1-0c77-487d-ab3e-63571202f698 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:11.925443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f763f1-0c77-487d-ab3e-63571202f698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:11.947892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f8f763f1-0c77-487d-ab3e-63571202f698 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:11.949321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f8f763f1-0c77-487d-ab3e-63571202f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:11.982854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 164/325] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:12.006766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd470a-10fd-4fa3-abac-2df735c9773d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:12.056960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 162/326] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:12.081919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f763f1-0c77-487d-ab3e-63571202f698 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:12.126662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:12.149627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd470a-10fd-4fa3-abac-2df735c9773d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:12.194186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a48c-3171-4521-9cd9-00f61519206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:12.194920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a48c-3171-4521-9cd9-00f61519206d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:12.195200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a48c-3171-4521-9cd9-00f61519206d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:12.195473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a48c-3171-4521-9cd9-00f61519206d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:12.208414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1a48c-3171-4521-9cd9-00f61519206d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:12.212187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f763f1-0c77-487d-ab3e-63571202f698 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-19b1a48c-3171-4521-9cd9-00f61519206d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:12.217273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:12.218224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:12.219006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 165/327] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:12.224625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a48c-3171-4521-9cd9-00f61519206d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:12.240266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:12.258159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd0b35-d004-4ecc-b560-053c47eaff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:12.259002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd0b35-d004-4ecc-b560-053c47eaff0c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:12.259253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd0b35-d004-4ecc-b560-053c47eaff0c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:12.259533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd0b35-d004-4ecc-b560-053c47eaff0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:12.272594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd0b35-d004-4ecc-b560-053c47eaff0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-addd0b35-d004-4ecc-b560-053c47eaff0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:12.281102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:12.282012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:12.282868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 163/328] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:12.288030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd0b35-d004-4ecc-b560-053c47eaff0c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:12.355884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a48c-3171-4521-9cd9-00f61519206d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:12.396628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:12.397621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:12.398939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:12.399832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:12.400776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:12.401526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:12.403600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:12.403737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:12.415109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 166/329] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:12.419199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd0b35-d004-4ecc-b560-053c47eaff0c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:12.422169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:12.465129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:12.466342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:12.466771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:12.467190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:12.468817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:12.469406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:12.471803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:12.482920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 164/330] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:12.488073 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:12.513591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:12.555183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee917ee-ecec-4c54-846a-e8c4cdf6b890 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:12.603449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade602c-7d0a-40e4-bb0d-10559081e280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:12.605307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade602c-7d0a-40e4-bb0d-10559081e280 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:12.605728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade602c-7d0a-40e4-bb0d-10559081e280 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:12.606189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade602c-7d0a-40e4-bb0d-10559081e280 None admin] PATH_INFO: `/v3/users/89825aa5c1404ece98af1b65ea6b1b26` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:12.607671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade602c-7d0a-40e4-bb0d-10559081e280 None admin] RBAC: Authorizing `identity:get_user(user_id=89825aa5c1404ece98af1b65ea6b1b26)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:12.610729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade602c-7d0a-40e4-bb0d-10559081e280 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:12.613679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 167/331] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:12 2022] GET /identity/v3/users/89825aa5c1404ece98af1b65ea6b1b26 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:12.615984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4140b-3629-435a-9b49-d883612aeb67 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:12.620106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade602c-7d0a-40e4-bb0d-10559081e280 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:12.660615 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1ec2-bd96-48ed-86ef-c5ab8c21f291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:12.662036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1ec2-bd96-48ed-86ef-c5ab8c21f291 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:12.662487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1ec2-bd96-48ed-86ef-c5ab8c21f291 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:12.662902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e1ec2-bd96-48ed-86ef-c5ab8c21f291 None admin] PATH_INFO: `/v3/users/7404b1db45f6439db09e7f4f055cdad1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:12.664478 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e1ec2-bd96-48ed-86ef-c5ab8c21f291 None admin] RBAC: Authorizing `identity:get_user(user_id=7404b1db45f6439db09e7f4f055cdad1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:12.666947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e1ec2-bd96-48ed-86ef-c5ab8c21f291 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:12.669062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 165/332] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:12 2022] GET /identity/v3/users/7404b1db45f6439db09e7f4f055cdad1 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:12.674871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1ec2-bd96-48ed-86ef-c5ab8c21f291 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:12.706156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:12.751459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade602c-7d0a-40e4-bb0d-10559081e280 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:12.792692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377aabf-e004-4f26-8ffc-3929be43335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:12.793467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377aabf-e004-4f26-8ffc-3929be43335f None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:12.793849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377aabf-e004-4f26-8ffc-3929be43335f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:12.794333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377aabf-e004-4f26-8ffc-3929be43335f None admin] PATH_INFO: `/v3/system/users/89825aa5c1404ece98af1b65ea6b1b26/roles/6d9f69d95e3246a1b656c43e5966fbc6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:12.796121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377aabf-e004-4f26-8ffc-3929be43335f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=89825aa5c1404ece98af1b65ea6b1b26, role_id=6d9f69d95e3246a1b656c43e5966fbc6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:12.797885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377aabf-e004-4f26-8ffc-3929be43335f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:12.806966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e1ec2-bd96-48ed-86ef-c5ab8c21f291 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:12.848760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9763f17-97bd-403e-85be-0e2866c94e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:12.849473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763f17-97bd-403e-85be-0e2866c94e51 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:12.849709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763f17-97bd-403e-85be-0e2866c94e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:12.850009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763f17-97bd-403e-85be-0e2866c94e51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:12.850859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9763f17-97bd-403e-85be-0e2866c94e51 None admin] RBAC: Adding query filter params (role.id=d9de94a33cd64dc88a723f03480c9e17, user.id=7404b1db45f6439db09e7f4f055cdad1, scope.system=all) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:12.851170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9763f17-97bd-403e-85be-0e2866c94e51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:12.852590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9763f17-97bd-403e-85be-0e2866c94e51 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:12.865751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 166/333] 10.222.0.36 () {56 vars in 1308 bytes} [Wed Jun 22 08:42:12 2022] GET /identity/v3/role_assignments?user.id=7404b1db45f6439db09e7f4f055cdad1&scope.system=all&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:12.881801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 168/334] 10.222.0.36 () {58 vars in 1334 bytes} [Wed Jun 22 08:42:12 2022] PUT /identity/v3/system/users/89825aa5c1404ece98af1b65ea6b1b26/roles/6d9f69d95e3246a1b656c43e5966fbc6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:14.506031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586d80-6e5f-4880-9da4-325fd6ff396f None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:14.506554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586d80-6e5f-4880-9da4-325fd6ff396f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:14.506816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586d80-6e5f-4880-9da4-325fd6ff396f None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:14.508327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 167/335] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:14.523993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe456ae-4a55-465b-a373-6798a09a3040 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:14.524481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe456ae-4a55-465b-a373-6798a09a3040 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:14.524553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe456ae-4a55-465b-a373-6798a09a3040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:14.529937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:14.544728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-efe456ae-4a55-465b-a373-6798a09a3040 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:14.558477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-efe456ae-4a55-465b-a373-6798a09a3040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:14.645392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 169/336] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:14.703475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586d80-6e5f-4880-9da4-325fd6ff396f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:14.813117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:14.862792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586d80-6e5f-4880-9da4-325fd6ff396f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:14.909772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28cf1b-d3df-41d1-9c3a-f0b9aeba7501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:14.910602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28cf1b-d3df-41d1-9c3a-f0b9aeba7501 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:14.910892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28cf1b-d3df-41d1-9c3a-f0b9aeba7501 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:14.911175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28cf1b-d3df-41d1-9c3a-f0b9aeba7501 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:14.925092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28cf1b-d3df-41d1-9c3a-f0b9aeba7501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-5e28cf1b-d3df-41d1-9c3a-f0b9aeba7501 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:14.932897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:14.933747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:14.934566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 168/337] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:14.941049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe456ae-4a55-465b-a373-6798a09a3040 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:15.077028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe456ae-4a55-465b-a373-6798a09a3040 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:15.116229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:15.122251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901d9f8-8127-4613-a0e4-f4539c8435b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:15.122927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901d9f8-8127-4613-a0e4-f4539c8435b1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.123216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901d9f8-8127-4613-a0e4-f4539c8435b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.123499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901d9f8-8127-4613-a0e4-f4539c8435b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.125132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901d9f8-8127-4613-a0e4-f4539c8435b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:15.125602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901d9f8-8127-4613-a0e4-f4539c8435b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:15.127030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901d9f8-8127-4613-a0e4-f4539c8435b1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:15.145869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 170/338] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:15.151866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28cf1b-d3df-41d1-9c3a-f0b9aeba7501 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:15.278803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28cf1b-d3df-41d1-9c3a-f0b9aeba7501 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:15.322842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc8253-f152-4b41-9543-b9da6b29c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:15.323497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8253-f152-4b41-9543-b9da6b29c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.323776 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8253-f152-4b41-9543-b9da6b29c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.324049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc8253-f152-4b41-9543-b9da6b29c9d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.333621 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:15.402678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc8253-f152-4b41-9543-b9da6b29c9d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:15.404118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc8253-f152-4b41-9543-b9da6b29c9d5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:15.501968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769cc63-76b3-4125-bb83-7e1e2af49c1b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.502338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769cc63-76b3-4125-bb83-7e1e2af49c1b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.502561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769cc63-76b3-4125-bb83-7e1e2af49c1b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.504207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 171/339] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:15.511452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba414d-67d5-40fe-8f93-77518529d04b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.511736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba414d-67d5-40fe-8f93-77518529d04b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.512014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba414d-67d5-40fe-8f93-77518529d04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.522569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 169/340] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:15.527722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc8253-f152-4b41-9543-b9da6b29c9d5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:15.553227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1dba414d-67d5-40fe-8f93-77518529d04b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:15.554446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1dba414d-67d5-40fe-8f93-77518529d04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:15.576430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:15.692501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc8253-f152-4b41-9543-b9da6b29c9d5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:15.740705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465a0b0-2e23-45d8-982d-1299dbb84877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:15.741576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465a0b0-2e23-45d8-982d-1299dbb84877 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.741856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465a0b0-2e23-45d8-982d-1299dbb84877 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.742149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465a0b0-2e23-45d8-982d-1299dbb84877 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.746826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465a0b0-2e23-45d8-982d-1299dbb84877 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:15.748280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465a0b0-2e23-45d8-982d-1299dbb84877 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:15.750858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 170/341] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:15 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:15.751930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e0da-bcf5-4b56-83ac-4bb4fb4080dc None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.752212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e0da-bcf5-4b56-83ac-4bb4fb4080dc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.752491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520e0da-bcf5-4b56-83ac-4bb4fb4080dc None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.753717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 171/342] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:15.759659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 172/343] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:15.760442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520e0da-bcf5-4b56-83ac-4bb4fb4080dc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:15.760983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8348efa-250e-4230-a7c6-526aee0e9a75 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.761266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8348efa-250e-4230-a7c6-526aee0e9a75 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.761542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8348efa-250e-4230-a7c6-526aee0e9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.787735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b8348efa-250e-4230-a7c6-526aee0e9a75 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:15.788931 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b8348efa-250e-4230-a7c6-526aee0e9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:15.882195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 173/344] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:15.884106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce9c8a-2463-4278-a3d5-c9e6b3ea4451 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.884634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce9c8a-2463-4278-a3d5-c9e6b3ea4451 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.885111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce9c8a-2463-4278-a3d5-c9e6b3ea4451 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.887233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 174/345] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:15.890669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce9c8a-2463-4278-a3d5-c9e6b3ea4451 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:15.928973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520e0da-bcf5-4b56-83ac-4bb4fb4080dc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:15.937392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:15.973060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419f08-0fc8-4354-8bea-7122bfa0cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:15.974375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f08-0fc8-4354-8bea-7122bfa0cb7a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.974865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f08-0fc8-4354-8bea-7122bfa0cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.975341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f08-0fc8-4354-8bea-7122bfa0cb7a None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:15.983159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca419f08-0fc8-4354-8bea-7122bfa0cb7a None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:15.984933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca419f08-0fc8-4354-8bea-7122bfa0cb7a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:15.987170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 172/346] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:15 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:15.987351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:15.989129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929df5e-b7a3-42ee-8cea-62f463b286c6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:15.989622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929df5e-b7a3-42ee-8cea-62f463b286c6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:15.990143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929df5e-b7a3-42ee-8cea-62f463b286c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.008002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7929df5e-b7a3-42ee-8cea-62f463b286c6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:16.009517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7929df5e-b7a3-42ee-8cea-62f463b286c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:16.048306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce9c8a-2463-4278-a3d5-c9e6b3ea4451 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:16.093958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 173/347] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:16.094868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929df5e-b7a3-42ee-8cea-62f463b286c6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:16.097811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249a07-f897-4c75-a0dd-2a3a105115c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:16.099037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249a07-f897-4c75-a0dd-2a3a105115c4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.099555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249a07-f897-4c75-a0dd-2a3a105115c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.100072 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249a07-f897-4c75-a0dd-2a3a105115c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.112602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7249a07-f897-4c75-a0dd-2a3a105115c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d7249a07-f897-4c75-a0dd-2a3a105115c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:16.121930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:16.122934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:16.123715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:16.126615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 175/348] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:16.127614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249a07-f897-4c75-a0dd-2a3a105115c4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:16.212715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:16.215352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929df5e-b7a3-42ee-8cea-62f463b286c6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:16.260546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249a07-f897-4c75-a0dd-2a3a105115c4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:16.266230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a95f2-2b7a-4fcb-8102-2b705b4354a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:16.267237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a95f2-2b7a-4fcb-8102-2b705b4354a0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.267684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a95f2-2b7a-4fcb-8102-2b705b4354a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.268096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a95f2-2b7a-4fcb-8102-2b705b4354a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.280325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:16.282237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a95f2-2b7a-4fcb-8102-2b705b4354a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-913a95f2-2b7a-4fcb-8102-2b705b4354a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:16.290771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:16.291757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:16.292542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 174/349] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:42:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:16.293784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384ebbc-f38a-4fd7-8dc3-2ed9f658551b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.293784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384ebbc-f38a-4fd7-8dc3-2ed9f658551b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.293953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384ebbc-f38a-4fd7-8dc3-2ed9f658551b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.295383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 175/350] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:16.296930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384ebbc-f38a-4fd7-8dc3-2ed9f658551b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:16.314847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:16.315830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.316117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.316395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.318179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] RBAC: Adding query filter params (group.id=670d0665701a4b7f8cdbf44c1934a465, role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=90903642dfe940ce8410308d77d923ff) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:16.318179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:16.319311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:16.332519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 176/351] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:16 2022] GET /identity/v3/role_assignments?group.id=670d0665701a4b7f8cdbf44c1934a465&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:16.333766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:16.431372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384ebbc-f38a-4fd7-8dc3-2ed9f658551b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:16.473777 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4401a80-a5ce-4dae-95a2-91d2626ad82e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:16.478439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:16.479123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.479409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.479686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.480450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] RBAC: Adding query filter params (name=member) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:16.480758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:16.482194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:16.493541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 176/352] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:16.494665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:16.524066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:16.527419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddbfdf-4309-4202-bde0-7cdb53b537b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:16.528245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddbfdf-4309-4202-bde0-7cdb53b537b2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.528527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddbfdf-4309-4202-bde0-7cdb53b537b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.532540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddbfdf-4309-4202-bde0-7cdb53b537b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.544607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddbfdf-4309-4202-bde0-7cdb53b537b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1eddbfdf-4309-4202-bde0-7cdb53b537b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:16.553724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:16.555378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:16.556344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:16.557626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 177/353] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:42:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:16.558894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30568-4a2a-4033-9afc-ee51cc1456ed None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.559180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30568-4a2a-4033-9afc-ee51cc1456ed None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.559456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30568-4a2a-4033-9afc-ee51cc1456ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.583526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4df30568-4a2a-4033-9afc-ee51cc1456ed None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:16.584715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4df30568-4a2a-4033-9afc-ee51cc1456ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:16.617653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:16.630142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae8b0a-23cb-493d-bdfe-363288a5d026 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:16.657348 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 178/354] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:16.657913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30568-4a2a-4033-9afc-ee51cc1456ed None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:16.676734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:16.677798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.679009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.680333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.682289 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:16.684090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:16.686428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:16.695921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 177/355] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:16.696816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:16.800341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30568-4a2a-4033-9afc-ee51cc1456ed None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:16.805376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:16.827883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8decff-617d-49ed-a0d2-0969347f16f4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:16.856805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997441da-2442-44b0-9eae-eff0fcbac0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:16.857468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997441da-2442-44b0-9eae-eff0fcbac0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.857754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997441da-2442-44b0-9eae-eff0fcbac0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.858032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997441da-2442-44b0-9eae-eff0fcbac0b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.880317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:16.881382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:16.881859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:16.882372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:16.883310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:16.883811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:16.887324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:16.896915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 178/356] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:16.902544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:16.903105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:16.947326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997441da-2442-44b0-9eae-eff0fcbac0b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:16.948806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997441da-2442-44b0-9eae-eff0fcbac0b8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:17.047126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096470a6-e627-4c35-96e4-8d516d92e9af None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:17.081414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 179/357] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:17.082438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997441da-2442-44b0-9eae-eff0fcbac0b8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:17.098369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2233c-a4bb-4475-92d9-c138a5b9e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:17.099458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2233c-a4bb-4475-92d9-c138a5b9e6db None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.099931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2233c-a4bb-4475-92d9-c138a5b9e6db None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.100276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2233c-a4bb-4475-92d9-c138a5b9e6db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.115150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2233c-a4bb-4475-92d9-c138a5b9e6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-cae2233c-a4bb-4475-92d9-c138a5b9e6db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:17.124217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:17.125216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:17.126276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 179/358] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:17.126993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2233c-a4bb-4475-92d9-c138a5b9e6db None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:17.137594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:17.167483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:17.214900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997441da-2442-44b0-9eae-eff0fcbac0b8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:17.256656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2233c-a4bb-4475-92d9-c138a5b9e6db None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:17.263377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59730cd3-d22e-4288-8dbd-16e35c4862ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:17.264114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730cd3-d22e-4288-8dbd-16e35c4862ac None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.266441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730cd3-d22e-4288-8dbd-16e35c4862ac None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.266441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59730cd3-d22e-4288-8dbd-16e35c4862ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.299689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c5c5-8ce1-46d2-990b-89f3843a1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:17.300491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c5c5-8ce1-46d2-990b-89f3843a1444 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.300817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c5c5-8ce1-46d2-990b-89f3843a1444 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.301088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523c5c5-8ce1-46d2-990b-89f3843a1444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.360874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59730cd3-d22e-4288-8dbd-16e35c4862ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:17.362379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59730cd3-d22e-4288-8dbd-16e35c4862ac None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:17.386951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c5c5-8ce1-46d2-990b-89f3843a1444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:17.388809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523c5c5-8ce1-46d2-990b-89f3843a1444 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:17.399624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:17.450482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:17.497019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 180/359] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:17.498251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9e97-2720-480e-84ad-b386770b0060 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.498547 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9e97-2720-480e-84ad-b386770b0060 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.499371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd9e97-2720-480e-84ad-b386770b0060 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.505407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 181/360] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:17.505407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd9e97-2720-480e-84ad-b386770b0060 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:17.525223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 180/361] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:17.526695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c5c5-8ce1-46d2-990b-89f3843a1444 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:17.647870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd9e97-2720-480e-84ad-b386770b0060 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:17.666318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523c5c5-8ce1-46d2-990b-89f3843a1444 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:17.677285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:17.692491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06cc06-1c40-4fb9-9af7-dc7b3eabd4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:17.693641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06cc06-1c40-4fb9-9af7-dc7b3eabd4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.694147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06cc06-1c40-4fb9-9af7-dc7b3eabd4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.694625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06cc06-1c40-4fb9-9af7-dc7b3eabd4a2 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.696024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06cc06-1c40-4fb9-9af7-dc7b3eabd4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:17.697645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06cc06-1c40-4fb9-9af7-dc7b3eabd4a2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:17.699380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 182/362] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:17.700528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632304-4f77-48f6-a7e9-bf2b12921ea2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.700808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632304-4f77-48f6-a7e9-bf2b12921ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.701150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632304-4f77-48f6-a7e9-bf2b12921ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.713523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:17.714236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.714568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.714845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.715850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:17.715968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:17.717262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:17.723363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-50632304-4f77-48f6-a7e9-bf2b12921ea2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:17.725021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-50632304-4f77-48f6-a7e9-bf2b12921ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:17.727731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 181/363] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:17.728561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:17.765123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:17.818808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 183/364] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:17.820220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50632304-4f77-48f6-a7e9-bf2b12921ea2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:17.865148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c39ad-92e1-4040-ae3f-5024ce93038f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:17.902295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c78b-cb73-4d14-a1d9-0d190063cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:17.903483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c78b-cb73-4d14-a1d9-0d190063cd72 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.903958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c78b-cb73-4d14-a1d9-0d190063cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.904437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334c78b-cb73-4d14-a1d9-0d190063cd72 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.906575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334c78b-cb73-4d14-a1d9-0d190063cd72 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:17.908059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334c78b-cb73-4d14-a1d9-0d190063cd72 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:17.909787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 182/365] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:17.911231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c78b-cb73-4d14-a1d9-0d190063cd72 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:17.941078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50632304-4f77-48f6-a7e9-bf2b12921ea2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:17.959169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:17.990872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a97a-1cdc-4700-9ab4-db53f991c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:17.991735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a97a-1cdc-4700-9ab4-db53f991c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:17.992043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a97a-1cdc-4700-9ab4-db53f991c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:17.992300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a97a-1cdc-4700-9ab4-db53f991c8e1 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:17.993532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15a97a-1cdc-4700-9ab4-db53f991c8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:17.995165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15a97a-1cdc-4700-9ab4-db53f991c8e1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:17.997052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 184/366] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:17.997672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a97a-1cdc-4700-9ab4-db53f991c8e1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.037091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:18.044462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334c78b-cb73-4d14-a1d9-0d190063cd72 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.086035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240c301-e7f0-45e3-b869-73b9d5611bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.086942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c301-e7f0-45e3-b869-73b9d5611bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.087230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c301-e7f0-45e3-b869-73b9d5611bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.087509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240c301-e7f0-45e3-b869-73b9d5611bf0 None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.089048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240c301-e7f0-45e3-b869-73b9d5611bf0 None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.090914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240c301-e7f0-45e3-b869-73b9d5611bf0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.097982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 183/367] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.097982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240c301-e7f0-45e3-b869-73b9d5611bf0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.118706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a97a-1cdc-4700-9ab4-db53f991c8e1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.166613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7c919-b671-4d7e-90c1-df9fa467c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.167415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7c919-b671-4d7e-90c1-df9fa467c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.167700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7c919-b671-4d7e-90c1-df9fa467c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.167979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7c919-b671-4d7e-90c1-df9fa467c5a9 None admin] PATH_INFO: `/v3/users/89825aa5c1404ece98af1b65ea6b1b26` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.169300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7c919-b671-4d7e-90c1-df9fa467c5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=89825aa5c1404ece98af1b65ea6b1b26)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.171873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7c919-b671-4d7e-90c1-df9fa467c5a9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.178082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 185/368] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:42:17 2022] GET /identity/v3/users/89825aa5c1404ece98af1b65ea6b1b26 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.178082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7c919-b671-4d7e-90c1-df9fa467c5a9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.231099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240c301-e7f0-45e3-b869-73b9d5611bf0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.234343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:18.270564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428cce6-c2c9-4b7d-9625-5f9732606ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.271569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428cce6-c2c9-4b7d-9625-5f9732606ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.273451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428cce6-c2c9-4b7d-9625-5f9732606ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.273451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428cce6-c2c9-4b7d-9625-5f9732606ab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.285310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428cce6-c2c9-4b7d-9625-5f9732606ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-4428cce6-c2c9-4b7d-9625-5f9732606ab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:18.294117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:18.295013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:18.296569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 184/369] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:18.297214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428cce6-c2c9-4b7d-9625-5f9732606ab3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.304784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7c919-b671-4d7e-90c1-df9fa467c5a9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.306600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:18.353707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e08da-8a09-4e21-9f46-177ed4dbc8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.354711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e08da-8a09-4e21-9f46-177ed4dbc8cf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.354999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e08da-8a09-4e21-9f46-177ed4dbc8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.355279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e08da-8a09-4e21-9f46-177ed4dbc8cf None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.356462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e08da-8a09-4e21-9f46-177ed4dbc8cf None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.357883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e08da-8a09-4e21-9f46-177ed4dbc8cf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.360874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 186/370] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.361683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e08da-8a09-4e21-9f46-177ed4dbc8cf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.431167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428cce6-c2c9-4b7d-9625-5f9732606ab3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.481432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83ce4-7ca9-46e1-92b6-8d33d0aaef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.481432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83ce4-7ca9-46e1-92b6-8d33d0aaef1c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.481714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83ce4-7ca9-46e1-92b6-8d33d0aaef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.481959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc83ce4-7ca9-46e1-92b6-8d33d0aaef1c None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.483665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc83ce4-7ca9-46e1-92b6-8d33d0aaef1c None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.485284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc83ce4-7ca9-46e1-92b6-8d33d0aaef1c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.488980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 185/371] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.488980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83ce4-7ca9-46e1-92b6-8d33d0aaef1c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.505702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e08da-8a09-4e21-9f46-177ed4dbc8cf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.527746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:18.544312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.544976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.545269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.546149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.547093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] RBAC: Adding query filter params (group.id=670d0665701a4b7f8cdbf44c1934a465, role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=bfc98143553e408eab2fd06c84a65bdd) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:18.547410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.548834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.559823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 187/372] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/role_assignments?group.id=670d0665701a4b7f8cdbf44c1934a465&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.560620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.610197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc83ce4-7ca9-46e1-92b6-8d33d0aaef1c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.611329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:18.650561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.651541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.652002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.652486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.653521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] RBAC: Adding query filter params (role.id=6d9f69d95e3246a1b656c43e5966fbc6, user.id=89825aa5c1404ece98af1b65ea6b1b26, scope.system=all) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:18.654026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.655872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.669329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 186/373] 10.222.0.36 () {56 vars in 1308 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/role_assignments?user.id=89825aa5c1404ece98af1b65ea6b1b26&scope.system=all&role.id=6d9f69d95e3246a1b656c43e5966fbc6 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.670031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.701381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff0d4-730f-44a2-8a2f-7f4e1b3eff15 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.759350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.760036 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.760313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.760584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.761345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:18.761658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.763091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.777531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 188/374] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.778540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.803928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:18.820660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6f3e4-58ca-425a-a61b-3370be82c328 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.871229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11055a-dddf-4f46-800d-5de3848aa301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.871985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11055a-dddf-4f46-800d-5de3848aa301 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.872339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11055a-dddf-4f46-800d-5de3848aa301 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.872714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11055a-dddf-4f46-800d-5de3848aa301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.874499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11055a-dddf-4f46-800d-5de3848aa301 None admin] RBAC: Adding query filter params (group.id=670d0665701a4b7f8cdbf44c1934a465, role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=90903642dfe940ce8410308d77d923ff) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:18.874706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11055a-dddf-4f46-800d-5de3848aa301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.876871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11055a-dddf-4f46-800d-5de3848aa301 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.883421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 187/375] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/role_assignments?group.id=670d0665701a4b7f8cdbf44c1934a465&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.885640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7698-3f43-424e-b3a2-b865a902a9b6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.886268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7698-3f43-424e-b3a2-b865a902a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.886743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c7698-3f43-424e-b3a2-b865a902a9b6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.890156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 188/376] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:18.891360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7698-3f43-424e-b3a2-b865a902a9b6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:18.908855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:18.917232 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23502769-c78c-447a-88cc-cd7b408348b7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:18.972380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f697-8ef7-4975-b16b-14aa0507d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:18.973078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f697-8ef7-4975-b16b-14aa0507d24d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.973424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f697-8ef7-4975-b16b-14aa0507d24d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.973768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f697-8ef7-4975-b16b-14aa0507d24d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:18.974729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f697-8ef7-4975-b16b-14aa0507d24d None admin] RBAC: Adding query filter params (group.id=670d0665701a4b7f8cdbf44c1934a465, role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=bfc98143553e408eab2fd06c84a65bdd) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:18.975114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f697-8ef7-4975-b16b-14aa0507d24d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:18.977354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f697-8ef7-4975-b16b-14aa0507d24d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:18.986209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 189/377] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/role_assignments?group.id=670d0665701a4b7f8cdbf44c1934a465&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:18.988126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946adcc-1084-41ff-8803-b96d2fbb3055 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:18.988490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946adcc-1084-41ff-8803-b96d2fbb3055 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:18.988819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946adcc-1084-41ff-8803-b96d2fbb3055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:19.010597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c946adcc-1084-41ff-8803-b96d2fbb3055 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:19.012631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c946adcc-1084-41ff-8803-b96d2fbb3055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:19.061322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c7698-3f43-424e-b3a2-b865a902a9b6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:19.105656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c46f11-53c2-478c-85b8-92181025a6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:19.107362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c46f11-53c2-478c-85b8-92181025a6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:19.108094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c46f11-53c2-478c-85b8-92181025a6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:19.109227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c46f11-53c2-478c-85b8-92181025a6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:19.142541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:19.195105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c46f11-53c2-478c-85b8-92181025a6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:19.196936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c46f11-53c2-478c-85b8-92181025a6d0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:19.208459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 190/378] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:19.244842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946adcc-1084-41ff-8803-b96d2fbb3055 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:19.321302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 189/379] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:19.331175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c46f11-53c2-478c-85b8-92181025a6d0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:19.399766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:19.412141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:19.433838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946adcc-1084-41ff-8803-b96d2fbb3055 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:19.452628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c46f11-53c2-478c-85b8-92181025a6d0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:19.492027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d34e3-6db6-4302-b7c7-befbdccbe1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:19.493818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d34e3-6db6-4302-b7c7-befbdccbe1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:19.494371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d34e3-6db6-4302-b7c7-befbdccbe1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:19.494680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d34e3-6db6-4302-b7c7-befbdccbe1a4 None admin] PATH_INFO: `/v3/projects/4ead886d5c674d14a096a137e80b192b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:19.497269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d34e3-6db6-4302-b7c7-befbdccbe1a4 None admin] RBAC: Authorizing `identity:get_project(project_id=4ead886d5c674d14a096a137e80b192b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:19.497669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d34e3-6db6-4302-b7c7-befbdccbe1a4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:19.500954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 190/380] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:19 2022] GET /identity/v3/projects/4ead886d5c674d14a096a137e80b192b => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:19.506250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d34e3-6db6-4302-b7c7-befbdccbe1a4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:19.506644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666a5c2-a05a-4fc1-a627-36c307a94ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:19.507688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a5c2-a05a-4fc1-a627-36c307a94ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:19.508178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a5c2-a05a-4fc1-a627-36c307a94ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:19.508656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a5c2-a05a-4fc1-a627-36c307a94ed4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:19.524609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666a5c2-a05a-4fc1-a627-36c307a94ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0666a5c2-a05a-4fc1-a627-36c307a94ed4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:19.535379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:19.536319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:19.537136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:19.540037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 191/381] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:19.545667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666a5c2-a05a-4fc1-a627-36c307a94ed4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:19.632850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d34e3-6db6-4302-b7c7-befbdccbe1a4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:19.662352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:19.667329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666a5c2-a05a-4fc1-a627-36c307a94ed4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:19.676200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836646-67f4-4e52-93c2-d09f40c3099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:19.679549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836646-67f4-4e52-93c2-d09f40c3099a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:19.679549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836646-67f4-4e52-93c2-d09f40c3099a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:19.679549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836646-67f4-4e52-93c2-d09f40c3099a None admin] PATH_INFO: `/v3/groups/ab3d444c5dd8428a824ed338795ddec5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:19.687534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836646-67f4-4e52-93c2-d09f40c3099a None admin] RBAC: Authorizing `identity:get_group(group_id=ab3d444c5dd8428a824ed338795ddec5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:19.690263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836646-67f4-4e52-93c2-d09f40c3099a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:19.695833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 191/382] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:19 2022] GET /identity/v3/groups/ab3d444c5dd8428a824ed338795ddec5 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:19.699540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836646-67f4-4e52-93c2-d09f40c3099a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:19.731929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:19.733947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:19.734468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:19.734999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:19.736850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:19.737379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:19.741282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:19.757909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 192/383] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:19.764564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:19.799644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:19.887395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836646-67f4-4e52-93c2-d09f40c3099a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:19.955081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be52f-2e64-4acd-80de-d8d130ba9e6e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:19.966131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:19.967120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:19.968221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:19.968843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:19.970191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] RBAC: Adding query filter params (group.id=ab3d444c5dd8428a824ed338795ddec5, role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=4ead886d5c674d14a096a137e80b192b) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:19.970766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:19.972516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:19.992080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 192/384] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:19 2022] GET /identity/v3/role_assignments?group.id=ab3d444c5dd8428a824ed338795ddec5&scope.project.id=4ead886d5c674d14a096a137e80b192b&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 260 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:20.008511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214b95-036a-48a0-aeed-7631e920a74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:20.009553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214b95-036a-48a0-aeed-7631e920a74e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:20.009839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214b95-036a-48a0-aeed-7631e920a74e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:20.010135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214b95-036a-48a0-aeed-7631e920a74e None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:20.015918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd214b95-036a-48a0-aeed-7631e920a74e None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:20.017500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd214b95-036a-48a0-aeed-7631e920a74e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:20.019650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 193/385] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:19 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:20.025203 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:20.110010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:20.190427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1416c06-69a8-4503-9d3c-82bd0c368cc2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:20.240752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612332-eea2-48d9-8e07-6ed8e299b1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:20.241627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612332-eea2-48d9-8e07-6ed8e299b1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:20.241907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612332-eea2-48d9-8e07-6ed8e299b1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:20.242206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612332-eea2-48d9-8e07-6ed8e299b1f5 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:20.243398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612332-eea2-48d9-8e07-6ed8e299b1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:20.244811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd612332-eea2-48d9-8e07-6ed8e299b1f5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:20.246913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 193/386] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:20 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:20.253222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214b95-036a-48a0-aeed-7631e920a74e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:20.343754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:20.360551 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214b95-036a-48a0-aeed-7631e920a74e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:20.399760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc6940-9778-463a-9d11-7f909747d072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:20.400644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc6940-9778-463a-9d11-7f909747d072 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:20.400928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc6940-9778-463a-9d11-7f909747d072 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:20.401204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc6940-9778-463a-9d11-7f909747d072 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff/groups/670d0665701a4b7f8cdbf44c1934a465/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:20.403184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc6940-9778-463a-9d11-7f909747d072 None admin] RBAC: Authorizing `identity:create_grant(project_id=90903642dfe940ce8410308d77d923ff, group_id=670d0665701a4b7f8cdbf44c1934a465, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:20.404611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc6940-9778-463a-9d11-7f909747d072 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:20.500008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 194/387] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 22 08:42:20 2022] PUT /identity/v3/projects/90903642dfe940ce8410308d77d923ff/groups/670d0665701a4b7f8cdbf44c1934a465/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:21.007323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48d6e-478c-4e68-b43a-e7c99a556323 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.008329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48d6e-478c-4e68-b43a-e7c99a556323 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.008830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48d6e-478c-4e68-b43a-e7c99a556323 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.010675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 194/388] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:21.016727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2709ca-4005-415d-a998-877369f57a66 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.017564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2709ca-4005-415d-a998-877369f57a66 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.018046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2709ca-4005-415d-a998-877369f57a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.038608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8b2709ca-4005-415d-a998-877369f57a66 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:21.040129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8b2709ca-4005-415d-a998-877369f57a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:21.135657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 195/389] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:21.170323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb48d6e-478c-4e68-b43a-e7c99a556323 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:21.304056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb48d6e-478c-4e68-b43a-e7c99a556323 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:21.328295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:21.351412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73455-2b69-4b50-86c1-e813b38f6fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:21.356319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73455-2b69-4b50-86c1-e813b38f6fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.356319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73455-2b69-4b50-86c1-e813b38f6fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.356319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73455-2b69-4b50-86c1-e813b38f6fa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.370945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73455-2b69-4b50-86c1-e813b38f6fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d1f73455-2b69-4b50-86c1-e813b38f6fa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:21.382874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:21.384004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:21.384869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 195/390] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:21.390609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2709ca-4005-415d-a998-877369f57a66 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:21.486278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:21.504445 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352d27a-1921-4368-9723-26a76bbb3975 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.505040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352d27a-1921-4368-9723-26a76bbb3975 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.505040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352d27a-1921-4368-9723-26a76bbb3975 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.506606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 196/391] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:42:21.513836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225b55-9d43-4e6a-9151-cf9d6f755a26 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.513836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225b55-9d43-4e6a-9151-cf9d6f755a26 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.513836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc225b55-9d43-4e6a-9151-cf9d6f755a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.534850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cc225b55-9d43-4e6a-9151-cf9d6f755a26 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:21.539499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cc225b55-9d43-4e6a-9151-cf9d6f755a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:21.546117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2709ca-4005-415d-a998-877369f57a66 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:21.590101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019b70d-6f6b-49f1-a548-48ca109231eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:21.591042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019b70d-6f6b-49f1-a548-48ca109231eb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.591335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019b70d-6f6b-49f1-a548-48ca109231eb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.591612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019b70d-6f6b-49f1-a548-48ca109231eb None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.593202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019b70d-6f6b-49f1-a548-48ca109231eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:21.593524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019b70d-6f6b-49f1-a548-48ca109231eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:21.595446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019b70d-6f6b-49f1-a548-48ca109231eb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:21.606383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 196/392] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:21.608529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dfdad-5812-43fd-8c07-8bd9e9db4d21 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.608831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dfdad-5812-43fd-8c07-8bd9e9db4d21 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.609379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dfdad-5812-43fd-8c07-8bd9e9db4d21 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.611136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 197/393] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:21.612673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dfdad-5812-43fd-8c07-8bd9e9db4d21 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:21.622316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 197/394] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:21.623764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f7a2-613e-4476-a22a-4a37b9771e89 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.624068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f7a2-613e-4476-a22a-4a37b9771e89 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.624346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f7a2-613e-4476-a22a-4a37b9771e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.657476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cdc8f7a2-613e-4476-a22a-4a37b9771e89 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:21.658763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cdc8f7a2-613e-4476-a22a-4a37b9771e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:21.732991 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 198/395] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:21.733930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8f7a2-613e-4476-a22a-4a37b9771e89 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:21.747301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dfdad-5812-43fd-8c07-8bd9e9db4d21 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:21.783573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:21.791158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:21.797835 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1231777-3be7-4180-8d50-d50bba4f7997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:21.799398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231777-3be7-4180-8d50-d50bba4f7997 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.800170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231777-3be7-4180-8d50-d50bba4f7997 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.800677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1231777-3be7-4180-8d50-d50bba4f7997 None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.802863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1231777-3be7-4180-8d50-d50bba4f7997 None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:21.805006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1231777-3be7-4180-8d50-d50bba4f7997 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:21.807914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 198/396] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:21 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:21.808907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1231777-3be7-4180-8d50-d50bba4f7997 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:21.856201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8f7a2-613e-4476-a22a-4a37b9771e89 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:21.900269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762953a-9280-4661-b31c-5084249e12f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:21.901078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762953a-9280-4661-b31c-5084249e12f2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.902437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762953a-9280-4661-b31c-5084249e12f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.902437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762953a-9280-4661-b31c-5084249e12f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:21.913985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762953a-9280-4661-b31c-5084249e12f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-e762953a-9280-4661-b31c-5084249e12f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:21.924639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:21.925851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 199/397] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:21.927035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762953a-9280-4661-b31c-5084249e12f2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:21.941593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1231777-3be7-4180-8d50-d50bba4f7997 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:21.983714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499fd9-6b60-448b-b8be-acd893d9f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:21.984872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499fd9-6b60-448b-b8be-acd893d9f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:21.985162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499fd9-6b60-448b-b8be-acd893d9f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:21.985445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9499fd9-6b60-448b-b8be-acd893d9f3c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.000648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9499fd9-6b60-448b-b8be-acd893d9f3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a9499fd9-6b60-448b-b8be-acd893d9f3c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:22.011865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:22.012798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:22.013588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:22.017809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 199/398] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:22.018980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499fd9-6b60-448b-b8be-acd893d9f3c8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.055744 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:22.062347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762953a-9280-4661-b31c-5084249e12f2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.091300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:22.110760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e2c9e-f1d1-472d-8dcf-457a61275dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.111639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2c9e-f1d1-472d-8dcf-457a61275dad None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.111919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2c9e-f1d1-472d-8dcf-457a61275dad None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.112188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2c9e-f1d1-472d-8dcf-457a61275dad None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.113780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2c9e-f1d1-472d-8dcf-457a61275dad None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.115636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2c9e-f1d1-472d-8dcf-457a61275dad None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.118151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 200/399] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:21 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:22.119432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e2c9e-f1d1-472d-8dcf-457a61275dad None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.140319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9499fd9-6b60-448b-b8be-acd893d9f3c8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.184490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.185079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.185362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.185636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.186973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:22.187291 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.188938 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.200298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 200/400] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:22.201263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.241260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e2c9e-f1d1-472d-8dcf-457a61275dad None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.278681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.279771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.280989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.281558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.282659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:22.283166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.284733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.293768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 201/401] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:22.295022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.331866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:22.337532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211d1ef-5150-49c2-920a-3bbea5a55a8b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.368515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:22.383821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379770f1-ca5e-4c8c-bfba-e0307ae08eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379770f1-ca5e-4c8c-bfba-e0307ae08eac None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.385018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379770f1-ca5e-4c8c-bfba-e0307ae08eac None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.385298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379770f1-ca5e-4c8c-bfba-e0307ae08eac None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd/groups/670d0665701a4b7f8cdbf44c1934a465/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.388261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379770f1-ca5e-4c8c-bfba-e0307ae08eac None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc98143553e408eab2fd06c84a65bdd, group_id=670d0665701a4b7f8cdbf44c1934a465, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.390355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379770f1-ca5e-4c8c-bfba-e0307ae08eac None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.413078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872b252-83cf-4da9-a4ed-4b80d436203c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.450113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011b01f-53c8-4dc7-8e45-4cb7b30b5f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.450909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b01f-53c8-4dc7-8e45-4cb7b30b5f6c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.451197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b01f-53c8-4dc7-8e45-4cb7b30b5f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.451477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b01f-53c8-4dc7-8e45-4cb7b30b5f6c None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.453111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011b01f-53c8-4dc7-8e45-4cb7b30b5f6c None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.454572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011b01f-53c8-4dc7-8e45-4cb7b30b5f6c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.457420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 202/402] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:22 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:22.463620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 201/403] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 22 08:42:22 2022] PUT /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd/groups/670d0665701a4b7f8cdbf44c1934a465/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:22.474165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379770f1-ca5e-4c8c-bfba-e0307ae08eac None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.474309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011b01f-53c8-4dc7-8e45-4cb7b30b5f6c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.627016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:22.628507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379770f1-ca5e-4c8c-bfba-e0307ae08eac None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.633522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011b01f-53c8-4dc7-8e45-4cb7b30b5f6c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.677455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a11477-3eeb-4cda-b061-40f381834431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.678358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11477-3eeb-4cda-b061-40f381834431 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.678634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11477-3eeb-4cda-b061-40f381834431 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.678911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a11477-3eeb-4cda-b061-40f381834431 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.679768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f5f67-5ecb-4032-96bb-278ccc81e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.680094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a11477-3eeb-4cda-b061-40f381834431 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.680629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5f67-5ecb-4032-96bb-278ccc81e0cf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.680915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5f67-5ecb-4032-96bb-278ccc81e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.681206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f5f67-5ecb-4032-96bb-278ccc81e0cf None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.681511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a11477-3eeb-4cda-b061-40f381834431 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.682389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f5f67-5ecb-4032-96bb-278ccc81e0cf None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.683244 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 202/404] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:22 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:22.684105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f5f67-5ecb-4032-96bb-278ccc81e0cf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.684430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4ae9-a5fb-4555-a840-e12e2e5bdcfb None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.684752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4ae9-a5fb-4555-a840-e12e2e5bdcfb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.685035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af4ae9-a5fb-4555-a840-e12e2e5bdcfb None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.686556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 203/405] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:22 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:22.691413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 203/406] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:22.692568 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af4ae9-a5fb-4555-a840-e12e2e5bdcfb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.692671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f5f67-5ecb-4032-96bb-278ccc81e0cf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.753632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:22.818911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f5f67-5ecb-4032-96bb-278ccc81e0cf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.824913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af4ae9-a5fb-4555-a840-e12e2e5bdcfb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:22.858682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa735c-06ac-4c7a-9257-bb7b47b76d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.859908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa735c-06ac-4c7a-9257-bb7b47b76d8a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.860401 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa735c-06ac-4c7a-9257-bb7b47b76d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.860881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa735c-06ac-4c7a-9257-bb7b47b76d8a None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.862420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa735c-06ac-4c7a-9257-bb7b47b76d8a None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.864165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa735c-06ac-4c7a-9257-bb7b47b76d8a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.866703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 204/407] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:22 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:22.867450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd5ca5-2365-4359-90f3-17bb8c993dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:22.868338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5ca5-2365-4359-90f3-17bb8c993dbf None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.868621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5ca5-2365-4359-90f3-17bb8c993dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.868897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5ca5-2365-4359-90f3-17bb8c993dbf None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd/groups/670d0665701a4b7f8cdbf44c1934a465/roles/23dcaf1f585d4a03a6101a69a6bdd9f1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.869123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9ee8-cd1f-451c-aace-c9054cc826f5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:22.869590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9ee8-cd1f-451c-aace-c9054cc826f5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:22.870081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add9ee8-cd1f-451c-aace-c9054cc826f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:22.871398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd5ca5-2365-4359-90f3-17bb8c993dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=bfc98143553e408eab2fd06c84a65bdd, group_id=670d0665701a4b7f8cdbf44c1934a465, role_id=23dcaf1f585d4a03a6101a69a6bdd9f1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:22.872937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd5ca5-2365-4359-90f3-17bb8c993dbf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:22.890296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8add9ee8-cd1f-451c-aace-c9054cc826f5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:22.891654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8add9ee8-cd1f-451c-aace-c9054cc826f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:22.919634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:22.945892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 204/408] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 22 08:42:22 2022] PUT /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd/groups/670d0665701a4b7f8cdbf44c1934a465/roles/23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:22.952457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd5ca5-2365-4359-90f3-17bb8c993dbf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:22.986931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 205/409] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:23.026713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add9ee8-cd1f-451c-aace-c9054cc826f5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:23.115336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd5ca5-2365-4359-90f3-17bb8c993dbf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:23.142484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:23.153192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add9ee8-cd1f-451c-aace-c9054cc826f5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:23.158191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077072-5efb-42a3-a410-773efa45b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:23.159198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077072-5efb-42a3-a410-773efa45b133 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.159492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077072-5efb-42a3-a410-773efa45b133 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.159771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077072-5efb-42a3-a410-773efa45b133 None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff/groups/670d0665701a4b7f8cdbf44c1934a465/roles/23dcaf1f585d4a03a6101a69a6bdd9f1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.161972 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3077072-5efb-42a3-a410-773efa45b133 None admin] RBAC: Authorizing `identity:create_grant(project_id=90903642dfe940ce8410308d77d923ff, group_id=670d0665701a4b7f8cdbf44c1934a465, role_id=23dcaf1f585d4a03a6101a69a6bdd9f1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:23.163452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3077072-5efb-42a3-a410-773efa45b133 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:23.194936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9684b-3ff1-468b-8236-f7208ba48d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:23.195834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9684b-3ff1-468b-8236-f7208ba48d63 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.196120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9684b-3ff1-468b-8236-f7208ba48d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.196461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9684b-3ff1-468b-8236-f7208ba48d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.207473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9684b-3ff1-468b-8236-f7208ba48d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-70c9684b-3ff1-468b-8236-f7208ba48d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:23.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:23.216309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:23.217664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 206/410] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:23.218719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c8f2-81c2-4731-b657-a0b6e96f97e5 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.219010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c8f2-81c2-4731-b657-a0b6e96f97e5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.219284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c8f2-81c2-4731-b657-a0b6e96f97e5 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.220759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 207/411] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:23.227154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684c8f2-81c2-4731-b657-a0b6e96f97e5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:23.230615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 205/412] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 22 08:42:22 2022] PUT /identity/v3/projects/90903642dfe940ce8410308d77d923ff/groups/670d0665701a4b7f8cdbf44c1934a465/roles/23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:23.240716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff06a-8e5b-4260-a4e7-56cdc93d0206 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.242467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff06a-8e5b-4260-a4e7-56cdc93d0206 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.242467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff06a-8e5b-4260-a4e7-56cdc93d0206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.282700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-182ff06a-8e5b-4260-a4e7-56cdc93d0206 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:23.283863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-182ff06a-8e5b-4260-a4e7-56cdc93d0206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:23.302485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:23.425681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684c8f2-81c2-4731-b657-a0b6e96f97e5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:23.429518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 206/413] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:23.455043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ff06a-8e5b-4260-a4e7-56cdc93d0206 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:23.464836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:23.465514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.465798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.466095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.466866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:23.467246 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:23.469252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:23.480265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 208/414] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:23.488406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:23.620496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:23.624917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ff06a-8e5b-4260-a4e7-56cdc93d0206 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:23.634689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:23.659612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb0fe0-775d-4e73-82d1-ddf3ad8d198a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:23.662380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f50b6-e514-47e5-ab33-7cfc93da6ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:23.663510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f50b6-e514-47e5-ab33-7cfc93da6ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.664008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f50b6-e514-47e5-ab33-7cfc93da6ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.664685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f50b6-e514-47e5-ab33-7cfc93da6ee3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.689074 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f50b6-e514-47e5-ab33-7cfc93da6ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b62f50b6-e514-47e5-ab33-7cfc93da6ee3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:23.702177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:23.703164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:23.704116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 207/415] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:23.709585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d5bb-6dfc-4b95-95a1-28244d58649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:23.710655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d5bb-6dfc-4b95-95a1-28244d58649d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.710941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d5bb-6dfc-4b95-95a1-28244d58649d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.711217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d5bb-6dfc-4b95-95a1-28244d58649d None admin] PATH_INFO: `/v3/groups/ab3d444c5dd8428a824ed338795ddec5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.712975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d5bb-6dfc-4b95-95a1-28244d58649d None admin] RBAC: Authorizing `identity:get_group(group_id=ab3d444c5dd8428a824ed338795ddec5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:23.714545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d5bb-6dfc-4b95-95a1-28244d58649d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:23.717153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f50b6-e514-47e5-ab33-7cfc93da6ee3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:23.718880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 209/416] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:23 2022] GET /identity/v3/groups/ab3d444c5dd8428a824ed338795ddec5 => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:23.723096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d5bb-6dfc-4b95-95a1-28244d58649d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:23.844802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d5bb-6dfc-4b95-95a1-28244d58649d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:23.855510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f50b6-e514-47e5-ab33-7cfc93da6ee3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:23.890754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae25f3-71ea-4dac-81fc-5a5d948b0ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:23.892452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae25f3-71ea-4dac-81fc-5a5d948b0ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.892735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae25f3-71ea-4dac-81fc-5a5d948b0ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.893014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae25f3-71ea-4dac-81fc-5a5d948b0ef6 None admin] PATH_INFO: `/v3/projects/4ead886d5c674d14a096a137e80b192b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.894696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae25f3-71ea-4dac-81fc-5a5d948b0ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=4ead886d5c674d14a096a137e80b192b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:23.896130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae25f3-71ea-4dac-81fc-5a5d948b0ef6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:23.898560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:23.899222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:23.899505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:23.899780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:23.900537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:23.900844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:23.903245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:23.909030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 210/417] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:23 2022] GET /identity/v3/projects/4ead886d5c674d14a096a137e80b192b => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:23.917631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 208/418] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:23.922814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae25f3-71ea-4dac-81fc-5a5d948b0ef6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:23.923014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:23.956927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:23.978834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:24.096202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae25f3-71ea-4dac-81fc-5a5d948b0ef6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:24.099506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee03ebd-090f-43f4-ad4d-1b0f510c36be None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:24.139198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a99f-09e4-409c-a2c3-9344db290705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:24.141230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a99f-09e4-409c-a2c3-9344db290705 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.141652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a99f-09e4-409c-a2c3-9344db290705 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.142087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a99f-09e4-409c-a2c3-9344db290705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.173843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c71e-61f1-4e5f-b529-b8f146d08bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:24.176682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c71e-61f1-4e5f-b529-b8f146d08bd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.177579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c71e-61f1-4e5f-b529-b8f146d08bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.177998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c71e-61f1-4e5f-b529-b8f146d08bd4 None admin] PATH_INFO: `/v3/projects/4ead886d5c674d14a096a137e80b192b/groups/ab3d444c5dd8428a824ed338795ddec5/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.181146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c71e-61f1-4e5f-b529-b8f146d08bd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ead886d5c674d14a096a137e80b192b, group_id=ab3d444c5dd8428a824ed338795ddec5, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:24.187805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c71e-61f1-4e5f-b529-b8f146d08bd4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:24.238840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a99f-09e4-409c-a2c3-9344db290705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:24.240678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a99f-09e4-409c-a2c3-9344db290705 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:24.253000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 211/419] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 22 08:42:23 2022] PUT /identity/v3/projects/4ead886d5c674d14a096a137e80b192b/groups/ab3d444c5dd8428a824ed338795ddec5/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:24.268510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:24.384973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 209/420] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:24.391758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c71e-61f1-4e5f-b529-b8f146d08bd4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:24.489045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:24.508479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c71e-61f1-4e5f-b529-b8f146d08bd4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:24.545869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562437ca-8bec-4e98-ab56-caa40865d37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:24.546823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562437ca-8bec-4e98-ab56-caa40865d37e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.559369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562437ca-8bec-4e98-ab56-caa40865d37e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.559369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562437ca-8bec-4e98-ab56-caa40865d37e None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.559369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562437ca-8bec-4e98-ab56-caa40865d37e None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:24.559369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562437ca-8bec-4e98-ab56-caa40865d37e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:24.559369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 212/421] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:24 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:24.559746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a99f-09e4-409c-a2c3-9344db290705 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:24.686846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a99f-09e4-409c-a2c3-9344db290705 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:24.716930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:24.732928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7730be-4973-4726-b982-290f054378cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:24.733803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7730be-4973-4726-b982-290f054378cc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.734104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7730be-4973-4726-b982-290f054378cc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.734383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7730be-4973-4726-b982-290f054378cc None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.735700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7730be-4973-4726-b982-290f054378cc None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:24.737151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7730be-4973-4726-b982-290f054378cc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:24.738817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 210/422] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:24 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:24.744767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562437ca-8bec-4e98-ab56-caa40865d37e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:24.859859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562437ca-8bec-4e98-ab56-caa40865d37e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:24.878151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6df3-9b99-4f8d-8235-d8cf82bd6b19 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.878430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6df3-9b99-4f8d-8235-d8cf82bd6b19 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.878709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6df3-9b99-4f8d-8235-d8cf82bd6b19 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.880212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 211/423] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:24.885120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee767-286b-4de9-a628-f14aab59fec7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.885420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee767-286b-4de9-a628-f14aab59fec7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.885691 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee767-286b-4de9-a628-f14aab59fec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.900192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:24.900846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:24.901129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:24.901404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:24.902268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] RBAC: Adding query filter params (group.id=670d0665701a4b7f8cdbf44c1934a465, role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=90903642dfe940ce8410308d77d923ff) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:24.902585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:24.904016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:24.910939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 213/424] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:24 2022] GET /identity/v3/role_assignments?group.id=670d0665701a4b7f8cdbf44c1934a465&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:24.931335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-686ee767-286b-4de9-a628-f14aab59fec7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:24.932572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-686ee767-286b-4de9-a628-f14aab59fec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:25.048621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 212/425] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:25.099096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:25.124068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:25.228027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd831cac-56a3-4afb-a34b-1489dbe73c21 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:25.268477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebfd68-25ae-4763-a352-e4aae31772dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:25.269274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebfd68-25ae-4763-a352-e4aae31772dc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:25.269566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebfd68-25ae-4763-a352-e4aae31772dc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:25.269845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebfd68-25ae-4763-a352-e4aae31772dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:25.286599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebfd68-25ae-4763-a352-e4aae31772dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-82ebfd68-25ae-4763-a352-e4aae31772dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:25.294417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:25.295336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:25.296208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 214/426] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:25.301781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ee767-286b-4de9-a628-f14aab59fec7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:25.423069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2de2-6ee5-459b-b81c-dd942d84965d None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:25.423399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2de2-6ee5-459b-b81c-dd942d84965d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:25.423633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb2de2-6ee5-459b-b81c-dd942d84965d None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:25.426111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 215/427] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:42:25.435197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175b42-76b2-49c8-8110-afe447df73b3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:25.436565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175b42-76b2-49c8-8110-afe447df73b3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:25.437058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7175b42-76b2-49c8-8110-afe447df73b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:25.438372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ee767-286b-4de9-a628-f14aab59fec7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:25.455552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a7175b42-76b2-49c8-8110-afe447df73b3 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:25.457921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a7175b42-76b2-49c8-8110-afe447df73b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:25.472275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:25.492103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:25.493107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:25.493402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:25.493682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:25.496813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:25.497123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:25.499636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:25.511247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 213/428] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:25.518984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:25.562274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 216/429] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:25.593511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7175b42-76b2-49c8-8110-afe447df73b3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:25.596930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:25.657640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af457492-c2eb-4f43-8172-8534ba940be5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:25.706770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679d99-bb14-4b70-a3b9-2266825ab80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:25.707430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679d99-bb14-4b70-a3b9-2266825ab80b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:25.707716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679d99-bb14-4b70-a3b9-2266825ab80b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:25.707993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679d99-bb14-4b70-a3b9-2266825ab80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:25.728023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7175b42-76b2-49c8-8110-afe447df73b3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:25.769988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a6874-a558-425e-862d-35b04a879484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:25.771184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6874-a558-425e-862d-35b04a879484 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:25.771695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6874-a558-425e-862d-35b04a879484 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:25.772158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6874-a558-425e-862d-35b04a879484 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:25.776065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:25.784626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a6874-a558-425e-862d-35b04a879484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-df0a6874-a558-425e-862d-35b04a879484 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:25.793442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:25.794451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:25.795940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:25.797948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf679d99-bb14-4b70-a3b9-2266825ab80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:25.799204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 217/430] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:42:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:25.799447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf679d99-bb14-4b70-a3b9-2266825ab80b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:25.801291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6d1b-10bd-4a6a-a759-ab45f31d1528 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:25.801858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6d1b-10bd-4a6a-a759-ab45f31d1528 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:25.802530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6d1b-10bd-4a6a-a759-ab45f31d1528 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:25.805150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 218/431] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:25.812859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe010-1fd2-415f-944f-410fd9ddfe91 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:25.813134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe010-1fd2-415f-944f-410fd9ddfe91 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:25.813345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe010-1fd2-415f-944f-410fd9ddfe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:25.841744 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2affe010-1fd2-415f-944f-410fd9ddfe91 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:25.843820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2affe010-1fd2-415f-944f-410fd9ddfe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:25.925153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:25.931844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 214/432] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:25.931844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679d99-bb14-4b70-a3b9-2266825ab80b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:25.941190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 219/433] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:25.942034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe010-1fd2-415f-944f-410fd9ddfe91 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.035196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:26.051000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe010-1fd2-415f-944f-410fd9ddfe91 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.053261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679d99-bb14-4b70-a3b9-2266825ab80b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.086688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577fbac-89a1-4c62-91b2-835218ec8344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.087567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fbac-89a1-4c62-91b2-835218ec8344 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.087857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fbac-89a1-4c62-91b2-835218ec8344 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.088134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fbac-89a1-4c62-91b2-835218ec8344 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.088918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.089297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577fbac-89a1-4c62-91b2-835218ec8344 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.089575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.089859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.090167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.090753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577fbac-89a1-4c62-91b2-835218ec8344 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.090906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:26.091214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.097810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.098030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 220/434] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:25 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:26.098030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577fbac-89a1-4c62-91b2-835218ec8344 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.105735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 215/435] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:26.111062 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.165194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:26.210917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577fbac-89a1-4c62-91b2-835218ec8344 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.220727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5c7d7-3015-428a-bc84-4d5423a8c7e3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.252627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e65e3-feb7-4524-b846-7bd76f99cc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.254294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e65e3-feb7-4524-b846-7bd76f99cc6e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.254769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e65e3-feb7-4524-b846-7bd76f99cc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.254886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a69db-e2fb-4cb4-ba6f-857bb1d727c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.255332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e65e3-feb7-4524-b846-7bd76f99cc6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.255735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a69db-e2fb-4cb4-ba6f-857bb1d727c0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.256017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a69db-e2fb-4cb4-ba6f-857bb1d727c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.256326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a69db-e2fb-4cb4-ba6f-857bb1d727c0 None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.257465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a69db-e2fb-4cb4-ba6f-857bb1d727c0 None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.258936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a69db-e2fb-4cb4-ba6f-857bb1d727c0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.260566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 216/436] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:26.261331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a69db-e2fb-4cb4-ba6f-857bb1d727c0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.272350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e65e3-feb7-4524-b846-7bd76f99cc6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:26.276643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-052e65e3-feb7-4524-b846-7bd76f99cc6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:26.283752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:26.288014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 221/437] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:26.289061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e65e3-feb7-4524-b846-7bd76f99cc6e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.367971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a69db-e2fb-4cb4-ba6f-857bb1d727c0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.401643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bcbf4-41d6-407e-a021-0fb43d574673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.402350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bcbf4-41d6-407e-a021-0fb43d574673 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.402633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bcbf4-41d6-407e-a021-0fb43d574673 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.402908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bcbf4-41d6-407e-a021-0fb43d574673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.407857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e65e3-feb7-4524-b846-7bd76f99cc6e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.428726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:26.444678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.445735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.446017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.446321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.453498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] RBAC: Adding query filter params (group.id=670d0665701a4b7f8cdbf44c1934a465, role.id=d9de94a33cd64dc88a723f03480c9e17, scope.project.id=bfc98143553e408eab2fd06c84a65bdd) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:26.453498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.453498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.462105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 222/438] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/role_assignments?group.id=670d0665701a4b7f8cdbf44c1934a465&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=d9de94a33cd64dc88a723f03480c9e17 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:26.462105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.495341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bcbf4-41d6-407e-a021-0fb43d574673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.497135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bcbf4-41d6-407e-a021-0fb43d574673 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.518374 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:26.578772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f067-7ae7-4aa9-b23d-240b2a9046de None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.623174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.624301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.624582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.626047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.626047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:26.626047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.628230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.642691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 223/439] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:26.648635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.654353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 217/440] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:26.660510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bcbf4-41d6-407e-a021-0fb43d574673 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.704447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:26.769710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1911945-1d6c-47c4-a750-5a99b523ed52 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.776335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bcbf4-41d6-407e-a021-0fb43d574673 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.790394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:26.807163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa56b7-1a24-4335-8f42-657c5086c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.807813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa56b7-1a24-4335-8f42-657c5086c942 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.808094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa56b7-1a24-4335-8f42-657c5086c942 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.808370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa56b7-1a24-4335-8f42-657c5086c942 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.813738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e69f8-d947-4ee7-8490-144620bce981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.814631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e69f8-d947-4ee7-8490-144620bce981 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.814918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e69f8-d947-4ee7-8490-144620bce981 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.815195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e69f8-d947-4ee7-8490-144620bce981 None admin] PATH_INFO: `/v3/projects/bfc98143553e408eab2fd06c84a65bdd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.816384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e69f8-d947-4ee7-8490-144620bce981 None admin] RBAC: Authorizing `identity:get_project(project_id=bfc98143553e408eab2fd06c84a65bdd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.818315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e69f8-d947-4ee7-8490-144620bce981 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.821492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 218/441] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/projects/bfc98143553e408eab2fd06c84a65bdd => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:26.822826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016e93-e3b9-48b1-8dd8-72775483ac12 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.823485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016e93-e3b9-48b1-8dd8-72775483ac12 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.824074 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016e93-e3b9-48b1-8dd8-72775483ac12 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.825771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 219/442] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:26.826607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016e93-e3b9-48b1-8dd8-72775483ac12 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.881692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa56b7-1a24-4335-8f42-657c5086c942 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.883346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa56b7-1a24-4335-8f42-657c5086c942 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.927344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016e93-e3b9-48b1-8dd8-72775483ac12 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:26.927614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:26.962192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e7571-fe8e-4579-8738-2c0d01a05bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:26.963049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e7571-fe8e-4579-8738-2c0d01a05bcf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.963328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e7571-fe8e-4579-8738-2c0d01a05bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.963604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e7571-fe8e-4579-8738-2c0d01a05bcf None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.964771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e7571-fe8e-4579-8738-2c0d01a05bcf None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:26.966222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e7571-fe8e-4579-8738-2c0d01a05bcf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:26.968154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 220/443] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:26.969286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f46cc-3631-4c30-a64e-a3fd1b655ec7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:26.969580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f46cc-3631-4c30-a64e-a3fd1b655ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:26.969854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f46cc-3631-4c30-a64e-a3fd1b655ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:26.982379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 224/444] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:26.984121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa56b7-1a24-4335-8f42-657c5086c942 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:26.989960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b61f46cc-3631-4c30-a64e-a3fd1b655ec7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:26.991182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b61f46cc-3631-4c30-a64e-a3fd1b655ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:27.035703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:27.058688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 221/445] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:27.059589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f46cc-3631-4c30-a64e-a3fd1b655ec7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:27.083969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa56b7-1a24-4335-8f42-657c5086c942 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:27.119375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:27.120025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:27.120311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:27.120598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:27.121429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] RBAC: Adding query filter params (group.id=670d0665701a4b7f8cdbf44c1934a465, role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=bfc98143553e408eab2fd06c84a65bdd) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:27.121740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:27.123218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:27.129898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 225/446] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:26 2022] GET /identity/v3/role_assignments?group.id=670d0665701a4b7f8cdbf44c1934a465&scope.project.id=bfc98143553e408eab2fd06c84a65bdd&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:27.130725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:27.144130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:27.169684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f46cc-3631-4c30-a64e-a3fd1b655ec7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:27.208137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c521c3-ce63-4b58-8233-af04c7d20e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:27.209171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c521c3-ce63-4b58-8233-af04c7d20e2d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:27.209451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c521c3-ce63-4b58-8233-af04c7d20e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:27.209724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c521c3-ce63-4b58-8233-af04c7d20e2d None admin] PATH_INFO: `/v3/projects/90903642dfe940ce8410308d77d923ff` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:27.211025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c521c3-ce63-4b58-8233-af04c7d20e2d None admin] RBAC: Authorizing `identity:get_project(project_id=90903642dfe940ce8410308d77d923ff)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:27.212489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c521c3-ce63-4b58-8233-af04c7d20e2d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:27.214486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 222/447] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:27 2022] GET /identity/v3/projects/90903642dfe940ce8410308d77d923ff => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:27.220395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c521c3-ce63-4b58-8233-af04c7d20e2d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:27.254192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bda34-6f87-439a-93ff-b971b8ad7d1a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:27.271186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:27.293538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c773b02-72d9-40fe-998c-2941cc955f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:27.294606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c773b02-72d9-40fe-998c-2941cc955f61 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:27.295206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c773b02-72d9-40fe-998c-2941cc955f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:27.296112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c773b02-72d9-40fe-998c-2941cc955f61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:27.310952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c773b02-72d9-40fe-998c-2941cc955f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8c773b02-72d9-40fe-998c-2941cc955f61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:27.318803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:27.319888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:27.320710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 226/448] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:27.325769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c773b02-72d9-40fe-998c-2941cc955f61 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:27.342541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c521c3-ce63-4b58-8233-af04c7d20e2d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:27.377663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef5b46-ff0c-41b5-8312-e7a871097b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:27.378583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef5b46-ff0c-41b5-8312-e7a871097b33 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:27.378870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef5b46-ff0c-41b5-8312-e7a871097b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:27.379147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef5b46-ff0c-41b5-8312-e7a871097b33 None admin] PATH_INFO: `/v3/groups/670d0665701a4b7f8cdbf44c1934a465` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:27.380331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef5b46-ff0c-41b5-8312-e7a871097b33 None admin] RBAC: Authorizing `identity:get_group(group_id=670d0665701a4b7f8cdbf44c1934a465)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:27.381755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef5b46-ff0c-41b5-8312-e7a871097b33 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:27.383402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 223/449] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:27 2022] GET /identity/v3/groups/670d0665701a4b7f8cdbf44c1934a465 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:27.389468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef5b46-ff0c-41b5-8312-e7a871097b33 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:27.395042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:27.425821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c773b02-72d9-40fe-998c-2941cc955f61 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:27.460494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:27.461153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:27.461438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:27.461717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:27.462493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:27.462805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:27.464165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:27.473034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 227/450] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:27.478540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:27.486930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef5b46-ff0c-41b5-8312-e7a871097b33 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:27.501198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:27.521150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:27.521797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:27.522103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:27.522377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:27.523201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] RBAC: Adding query filter params (group.id=670d0665701a4b7f8cdbf44c1934a465, role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=90903642dfe940ce8410308d77d923ff) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:27.523514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:27.524918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:27.531461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 224/451] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:27 2022] GET /identity/v3/role_assignments?group.id=670d0665701a4b7f8cdbf44c1934a465&scope.project.id=90903642dfe940ce8410308d77d923ff&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:27.588985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c18eb-d357-41df-b9ec-e2fc6319d53e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:27.620278 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:27.625303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ecb76-2c18-42c9-8b18-664afc0b7c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:27.625967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecb76-2c18-42c9-8b18-664afc0b7c8e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:27.626280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecb76-2c18-42c9-8b18-664afc0b7c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:27.626558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecb76-2c18-42c9-8b18-664afc0b7c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:27.697430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ecb76-2c18-42c9-8b18-664afc0b7c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:27.698829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ecb76-2c18-42c9-8b18-664afc0b7c8e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:27.806301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 228/452] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:27.812772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:27.917720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f147ab-ea93-4c90-8f87-08c055505623 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:27.953062 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cc0a2-2d72-4843-bee1-221abcd01f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:27.953854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cc0a2-2d72-4843-bee1-221abcd01f54 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:27.954192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cc0a2-2d72-4843-bee1-221abcd01f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:27.954459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cc0a2-2d72-4843-bee1-221abcd01f54 None admin] PATH_INFO: `/v3/projects/4ead886d5c674d14a096a137e80b192b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:27.955676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cc0a2-2d72-4843-bee1-221abcd01f54 None admin] RBAC: Authorizing `identity:get_project(project_id=4ead886d5c674d14a096a137e80b192b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:27.957116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cc0a2-2d72-4843-bee1-221abcd01f54 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:27.958841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 225/453] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:42:27 2022] GET /identity/v3/projects/4ead886d5c674d14a096a137e80b192b => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:27.964457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ecb76-2c18-42c9-8b18-664afc0b7c8e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:27.997457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:28.069943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ecb76-2c18-42c9-8b18-664afc0b7c8e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:28.106774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af11a95-b63d-4184-b640-79e88e14f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:28.107666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11a95-b63d-4184-b640-79e88e14f76a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:28.108096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11a95-b63d-4184-b640-79e88e14f76a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:28.108379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af11a95-b63d-4184-b640-79e88e14f76a None admin] PATH_INFO: `/v3/groups/ab3d444c5dd8428a824ed338795ddec5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:28.109548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af11a95-b63d-4184-b640-79e88e14f76a None admin] RBAC: Authorizing `identity:get_group(group_id=ab3d444c5dd8428a824ed338795ddec5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:28.111017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af11a95-b63d-4184-b640-79e88e14f76a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:28.112963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 229/454] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 22 08:42:27 2022] GET /identity/v3/groups/ab3d444c5dd8428a824ed338795ddec5 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:28.118657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cc0a2-2d72-4843-bee1-221abcd01f54 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:28.168409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:28.221666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cc0a2-2d72-4843-bee1-221abcd01f54 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:28.253099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20352-db48-4ad8-8ac1-67c4dcb307fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:28.253729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20352-db48-4ad8-8ac1-67c4dcb307fe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:28.254009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20352-db48-4ad8-8ac1-67c4dcb307fe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:28.254314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20352-db48-4ad8-8ac1-67c4dcb307fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:28.255134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e20352-db48-4ad8-8ac1-67c4dcb307fe None admin] RBAC: Adding query filter params (group.id=ab3d444c5dd8428a824ed338795ddec5, role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=4ead886d5c674d14a096a137e80b192b) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:28.255457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e20352-db48-4ad8-8ac1-67c4dcb307fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:28.256864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e20352-db48-4ad8-8ac1-67c4dcb307fe None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:28.262486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 226/455] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 22 08:42:28 2022] GET /identity/v3/role_assignments?group.id=ab3d444c5dd8428a824ed338795ddec5&scope.project.id=4ead886d5c674d14a096a137e80b192b&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:30.631299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda474be-33a5-4d90-ab06-d213ae38f7a9 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:30.632325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda474be-33a5-4d90-ab06-d213ae38f7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:30.632806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda474be-33a5-4d90-ab06-d213ae38f7a9 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:30.635044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 230/456] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:30.641260 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728579b-1963-416c-bb01-d8efa05c181b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:30.641731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728579b-1963-416c-bb01-d8efa05c181b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:30.641805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728579b-1963-416c-bb01-d8efa05c181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:30.669225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d728579b-1963-416c-bb01-d8efa05c181b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:30.670540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d728579b-1963-416c-bb01-d8efa05c181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:30.767803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 227/457] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:30.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda474be-33a5-4d90-ab06-d213ae38f7a9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:30.872531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc000cec-6363-4c50-91cd-3d4f362cef1c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:30.872832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc000cec-6363-4c50-91cd-3d4f362cef1c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:30.873619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc000cec-6363-4c50-91cd-3d4f362cef1c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:30.875331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 228/458] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:30.880209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5be82-cf51-463c-a22f-e0df764a3225 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:30.880500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5be82-cf51-463c-a22f-e0df764a3225 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:30.880778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5be82-cf51-463c-a22f-e0df764a3225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:30.915345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-73c5be82-cf51-463c-a22f-e0df764a3225 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:30.916503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-73c5be82-cf51-463c-a22f-e0df764a3225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:30.930434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:30.933629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda474be-33a5-4d90-ab06-d213ae38f7a9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:30.994707 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:30.995494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:30.995775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:30.996046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:30.998740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:31.017836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:31.019299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:31.040697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:31.041578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:31.042447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:31.042447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:31.042447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:31.042447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:31.042447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 231/459] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:31.048841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 229/460] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:31.054966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:31.091391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5be82-cf51-463c-a22f-e0df764a3225 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:31.264831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5be82-cf51-463c-a22f-e0df764a3225 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:31.268094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55d424-56fe-41cb-95ca-83ae7ce51a02 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:31.312822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:31.313494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.314254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.314532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.315257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:31.315561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:31.316923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:31.330702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 232/461] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:31.342861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:31.346196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae760ee6-3950-403f-a5d8-0f93035dacee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:31.347004 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760ee6-3950-403f-a5d8-0f93035dacee None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.347289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760ee6-3950-403f-a5d8-0f93035dacee None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.347557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760ee6-3950-403f-a5d8-0f93035dacee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.358888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae760ee6-3950-403f-a5d8-0f93035dacee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:31.359801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:31.360345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae760ee6-3950-403f-a5d8-0f93035dacee None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ae760ee6-3950-403f-a5d8-0f93035dacee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:31.379201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:31.385487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 230/462] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015abe0d-3c98-4ae9-ab79-b66acdffdb45 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015abe0d-3c98-4ae9-ab79-b66acdffdb45 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015abe0d-3c98-4ae9-ab79-b66acdffdb45 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.386362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 231/463] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:31.388199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015abe0d-3c98-4ae9-ab79-b66acdffdb45 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:31.421410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:31.473694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799eaa61-7d92-4df7-b5f9-b99cb3925499 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:31.518372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25929be8-253a-4396-9800-0dad1890f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:31.518961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929be8-253a-4396-9800-0dad1890f929 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.519245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929be8-253a-4396-9800-0dad1890f929 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.519521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929be8-253a-4396-9800-0dad1890f929 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.519888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015abe0d-3c98-4ae9-ab79-b66acdffdb45 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:31.520231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25929be8-253a-4396-9800-0dad1890f929 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:31.521922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25929be8-253a-4396-9800-0dad1890f929 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:31.558511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f39df-8ee5-42e2-b6a8-5694c2b8fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:31.559181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f39df-8ee5-42e2-b6a8-5694c2b8fd2b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.559460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f39df-8ee5-42e2-b6a8-5694c2b8fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.559758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f39df-8ee5-42e2-b6a8-5694c2b8fd2b None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.560483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f39df-8ee5-42e2-b6a8-5694c2b8fd2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:31.561326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f39df-8ee5-42e2-b6a8-5694c2b8fd2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:31.562708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f39df-8ee5-42e2-b6a8-5694c2b8fd2b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:31.579664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 232/464] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:31.579664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d42e93-4a90-4ba4-bff5-b554f56bd2d6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.579664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d42e93-4a90-4ba4-bff5-b554f56bd2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.579664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d42e93-4a90-4ba4-bff5-b554f56bd2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.596046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e2d42e93-4a90-4ba4-bff5-b554f56bd2d6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:31.597229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e2d42e93-4a90-4ba4-bff5-b554f56bd2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:31.620450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 233/465] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:42:31 2022] POST /identity/v3/users => generated 246 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:31.621273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25929be8-253a-4396-9800-0dad1890f929 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:31.725428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 233/466] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:31.726934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907819-b5cd-4fda-ac00-7a5da95717df None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.727231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907819-b5cd-4fda-ac00-7a5da95717df None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.727608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907819-b5cd-4fda-ac00-7a5da95717df None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.733711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 234/467] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:31.735010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a1cd-af93-4673-954d-1f33b5261429 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.735325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a1cd-af93-4673-954d-1f33b5261429 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.735680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a1cd-af93-4673-954d-1f33b5261429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.740128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:31.765621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9478a1cd-af93-4673-954d-1f33b5261429 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:31.767626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9478a1cd-af93-4673-954d-1f33b5261429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:31.780166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:31.800612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25929be8-253a-4396-9800-0dad1890f929 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:31.847803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3d68-715b-4139-a5e7-e914fd215181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:31.848491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3d68-715b-4139-a5e7-e914fd215181 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:31.848778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3d68-715b-4139-a5e7-e914fd215181 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:31.849056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3d68-715b-4139-a5e7-e914fd215181 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:31.849774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd3d68-715b-4139-a5e7-e914fd215181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:31.851794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd3d68-715b-4139-a5e7-e914fd215181 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:31.865548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 235/468] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:31.866843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478a1cd-af93-4673-954d-1f33b5261429 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:31.932219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 234/469] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:42:31 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:31.934241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3d68-715b-4139-a5e7-e914fd215181 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:31.985583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478a1cd-af93-4673-954d-1f33b5261429 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:32.028343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614d097-8de5-4521-a8bd-f514225dc2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:32.031117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614d097-8de5-4521-a8bd-f514225dc2be None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.031345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614d097-8de5-4521-a8bd-f514225dc2be None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.031625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614d097-8de5-4521-a8bd-f514225dc2be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.047945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614d097-8de5-4521-a8bd-f514225dc2be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:32.050131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614d097-8de5-4521-a8bd-f514225dc2be None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:32.060026 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:32.070799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3d68-715b-4139-a5e7-e914fd215181 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a614d097-8de5-4521-a8bd-f514225dc2be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:32.075973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:32.083433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:32.084277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:32.084277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:32.084277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:32.084277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:32.084277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 236/470] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:32.084277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b522538-6abc-47a3-acf8-c038e46a313b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.084594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b522538-6abc-47a3-acf8-c038e46a313b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.084594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b522538-6abc-47a3-acf8-c038e46a313b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.087044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 237/471] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:32.088204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b522538-6abc-47a3-acf8-c038e46a313b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:32.116599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:32.130306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82dd5d-7d02-45dd-8a8d-6e9ac10783c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:32.131867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82dd5d-7d02-45dd-8a8d-6e9ac10783c9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.131867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82dd5d-7d02-45dd-8a8d-6e9ac10783c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.131867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82dd5d-7d02-45dd-8a8d-6e9ac10783c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.145351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82dd5d-7d02-45dd-8a8d-6e9ac10783c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:32.147583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82dd5d-7d02-45dd-8a8d-6e9ac10783c9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7c82dd5d-7d02-45dd-8a8d-6e9ac10783c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:32.167978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:32.168875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:32.169736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:32.169736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:32.169736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:32.169736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:32.169736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 235/472] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:32.172068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c14c-a14b-4aff-9ef0-b988b1fba9ed None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.172068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c14c-a14b-4aff-9ef0-b988b1fba9ed None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.172248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6c14c-a14b-4aff-9ef0-b988b1fba9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.193838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-62b6c14c-a14b-4aff-9ef0-b988b1fba9ed None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:32.195089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-62b6c14c-a14b-4aff-9ef0-b988b1fba9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:32.225595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b522538-6abc-47a3-acf8-c038e46a313b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:32.271922 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:32.272592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.272880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.273159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.273892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:32.274229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:32.275598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:32.287460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 236/473] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:32.288255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c14c-a14b-4aff-9ef0-b988b1fba9ed None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:32.290115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 238/474] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:32.300945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:32.379744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:32.410712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6c14c-a14b-4aff-9ef0-b988b1fba9ed None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:32.419556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:32.430337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39976c76-918d-42f2-acc1-8c6cb8f40b76 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:32.449694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:32.450398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.450735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.451017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.452589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:32.452899 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:32.454351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:32.467975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 237/475] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:32.468908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:32.471290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc96d6-7f0f-474f-aa69-bd2bcc55ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:32.472692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc96d6-7f0f-474f-aa69-bd2bcc55ac2e None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.473188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc96d6-7f0f-474f-aa69-bd2bcc55ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.473655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc96d6-7f0f-474f-aa69-bd2bcc55ac2e None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.474583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc96d6-7f0f-474f-aa69-bd2bcc55ac2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:32.476337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc96d6-7f0f-474f-aa69-bd2bcc55ac2e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:32.578306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64184-8df7-4165-a6ef-c9855c107c4c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:32.590648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 239/476] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:42:32 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:32.591929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc96d6-7f0f-474f-aa69-bd2bcc55ac2e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:32.622342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:32.624082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.624470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.624747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.625595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:32.630918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:32.674416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.sql.core [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:42:32.674416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 08:42:32.674416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [parameters: {'id': '49068b0a53ba4de8a81fdbacf4b0b6f5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 08:42:32.674416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80310) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jun 22 08:42:32.699679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:42:32.700591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application yield resource Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise self.value Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application session.commit() Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:42:32.701580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:42:32.703014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:42:32.703879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:42:32.704670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [parameters: {'id': '49068b0a53ba4de8a81fdbacf4b0b6f5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:32.705432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 08:42:32.707358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:32.709398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 238/477] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 22 08:42:32 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:32.709398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:32.784043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:32.806766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc96d6-7f0f-474f-aa69-bd2bcc55ac2e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:32.823681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:32.854051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6400d63-343b-430a-804c-69ee3fabbcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:32.854844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6400d63-343b-430a-804c-69ee3fabbcc6 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.855132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6400d63-343b-430a-804c-69ee3fabbcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.856325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6400d63-343b-430a-804c-69ee3fabbcc6 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.857034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6400d63-343b-430a-804c-69ee3fabbcc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:32.859120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6400d63-343b-430a-804c-69ee3fabbcc6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:32.880213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ceac4-9eda-4e91-96db-530ec6ba1816 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:32.916819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48795d1-96c5-44f4-97ef-b5adb9195fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:32.917633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48795d1-96c5-44f4-97ef-b5adb9195fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:32.917919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48795d1-96c5-44f4-97ef-b5adb9195fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:32.918232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48795d1-96c5-44f4-97ef-b5adb9195fb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:32.930334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48795d1-96c5-44f4-97ef-b5adb9195fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b48795d1-96c5-44f4-97ef-b5adb9195fb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:32.938964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:32.939887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:32.942032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 239/478] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:42:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:32.948725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 240/479] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:42:32 2022] POST /identity/v3/users => generated 249 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:32.952006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48795d1-96c5-44f4-97ef-b5adb9195fb2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:33.062181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:33.072434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48795d1-96c5-44f4-97ef-b5adb9195fb2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:33.111624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f958331-d529-4452-831f-af2edfa9d1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:33.112276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f958331-d529-4452-831f-af2edfa9d1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:33.112566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f958331-d529-4452-831f-af2edfa9d1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:33.112849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f958331-d529-4452-831f-af2edfa9d1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:33.113619 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f958331-d529-4452-831f-af2edfa9d1a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:33.113932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f958331-d529-4452-831f-af2edfa9d1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:33.115345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f958331-d529-4452-831f-af2edfa9d1a4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:33.125602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 240/480] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:34.099057 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e66c23-e23c-4f92-a48c-76bbeaf5a16a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:34.099561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e66c23-e23c-4f92-a48c-76bbeaf5a16a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:34.099803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e66c23-e23c-4f92-a48c-76bbeaf5a16a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:34.101578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 241/481] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:34.107334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d9c4-aad5-453c-8a21-e510f1994cce None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:34.107771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d9c4-aad5-453c-8a21-e510f1994cce None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:34.108083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025d9c4-aad5-453c-8a21-e510f1994cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:34.125976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c025d9c4-aad5-453c-8a21-e510f1994cce None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:34.127369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c025d9c4-aad5-453c-8a21-e510f1994cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:34.198968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 241/482] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:34.223816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e66c23-e23c-4f92-a48c-76bbeaf5a16a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:34.340835 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e66c23-e23c-4f92-a48c-76bbeaf5a16a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:34.362239 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513436-adbc-4585-b286-f53d2bdcb161 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:34.362504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513436-adbc-4585-b286-f53d2bdcb161 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:34.362737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513436-adbc-4585-b286-f53d2bdcb161 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:34.364254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 242/483] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:34.371491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1516b8a-6e79-49cd-9699-dbd778c6820c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:34.371781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1516b8a-6e79-49cd-9699-dbd778c6820c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:34.372060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1516b8a-6e79-49cd-9699-dbd778c6820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:34.395993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d1516b8a-6e79-49cd-9699-dbd778c6820c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:34.397186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d1516b8a-6e79-49cd-9699-dbd778c6820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:34.407764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9423e0-097b-4fce-9620-e863670588b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:34.408573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9423e0-097b-4fce-9620-e863670588b5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:34.408862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9423e0-097b-4fce-9620-e863670588b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:34.409135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9423e0-097b-4fce-9620-e863670588b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:34.429985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9423e0-097b-4fce-9620-e863670588b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8a9423e0-097b-4fce-9620-e863670588b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:34.437798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:34.440017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:34.442030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 242/484] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:34.448556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9423e0-097b-4fce-9620-e863670588b5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:34.502441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:34.507900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 243/485] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:34.548690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1516b8a-6e79-49cd-9699-dbd778c6820c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:34.563893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:34.591408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9423e0-097b-4fce-9620-e863670588b5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:34.631033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:34.631732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:34.632019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:34.632292 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:34.633149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:34.633455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:34.635046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:34.645346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 243/486] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:34.651409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:34.676094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1516b8a-6e79-49cd-9699-dbd778c6820c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:34.712412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e859307-7512-4cd0-814e-41b5326034f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:34.713268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859307-7512-4cd0-814e-41b5326034f9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:34.713556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859307-7512-4cd0-814e-41b5326034f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:34.713834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e859307-7512-4cd0-814e-41b5326034f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:34.725529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e859307-7512-4cd0-814e-41b5326034f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3e859307-7512-4cd0-814e-41b5326034f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:34.734091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:34.736039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:34.737124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 244/487] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:34.744180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e859307-7512-4cd0-814e-41b5326034f9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:34.835260 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:34.855665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95690c03-e9b3-463f-90fa-0f7ee94f7471 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:34.880493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:34.920252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:34.920993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:34.921276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:34.921550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:34.936405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e859307-7512-4cd0-814e-41b5326034f9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:34.940364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:34.941819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:34.969028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:34.970112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:34.971157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:34.971157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:34.971157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:34.971157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:34.973609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 244/488] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:34.979816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.005615 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.006320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.006606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.006884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.007642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:35.007953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.009320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.028628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 245/489] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:35.030752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.162085 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8a3b-5d45-472b-9f98-9debbdd58d1f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.201063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bb59a-5231-4803-aade-c6b8d5746991 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.215520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085542a2-1e2e-42b4-bff2-3061b6551c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.216331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085542a2-1e2e-42b4-bff2-3061b6551c17 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.216635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085542a2-1e2e-42b4-bff2-3061b6551c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.217103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085542a2-1e2e-42b4-bff2-3061b6551c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.219789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:35.229663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085542a2-1e2e-42b4-bff2-3061b6551c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.231549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085542a2-1e2e-42b4-bff2-3061b6551c17 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.245078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17af3d-92a1-49de-94e1-9666bc3ee5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.245834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17af3d-92a1-49de-94e1-9666bc3ee5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.246233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17af3d-92a1-49de-94e1-9666bc3ee5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.246586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17af3d-92a1-49de-94e1-9666bc3ee5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.247497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17af3d-92a1-49de-94e1-9666bc3ee5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:35.247968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17af3d-92a1-49de-94e1-9666bc3ee5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.249996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17af3d-92a1-49de-94e1-9666bc3ee5b8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-085542a2-1e2e-42b4-bff2-3061b6551c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:35.253400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:35.254332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:35.255506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:35.255506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:35.255506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:35.255506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:35.255506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 246/490] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:35.256793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054165c2-b573-407a-a71e-16817cd736fa None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.256793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054165c2-b573-407a-a71e-16817cd736fa None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.256793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054165c2-b573-407a-a71e-16817cd736fa None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.262871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 247/491] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:35.264274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054165c2-b573-407a-a71e-16817cd736fa None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.265732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:35.269723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 245/492] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:35.275858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7df9e-3ed5-43aa-93d3-96376c7e829f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.281389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7df9e-3ed5-43aa-93d3-96376c7e829f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.281389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7df9e-3ed5-43aa-93d3-96376c7e829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.296000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a5d7df9e-3ed5-43aa-93d3-96376c7e829f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:35.297965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a5d7df9e-3ed5-43aa-93d3-96376c7e829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:35.378666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 246/493] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:35.379684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7df9e-3ed5-43aa-93d3-96376c7e829f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.404867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054165c2-b573-407a-a71e-16817cd736fa None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.441112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.441783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.442135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.442422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.443320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:35.443732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.445218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.459733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 248/494] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:35.460775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.500127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7df9e-3ed5-43aa-93d3-96376c7e829f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.512372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:35.531847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:35.538112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.539094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.539518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.539929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.547958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.549641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:35.568987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:35.570137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:42:35.571171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:35.571687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409b131-5ea0-4a54-9fb5-e31afe8fd4c0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.573494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 247/495] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:35.574650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.608683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a533a5-e7e8-4376-949c-9a00dfc0f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.614214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a533a5-e7e8-4376-949c-9a00dfc0f779 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.614214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a533a5-e7e8-4376-949c-9a00dfc0f779 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.614214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a533a5-e7e8-4376-949c-9a00dfc0f779 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.621746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a533a5-e7e8-4376-949c-9a00dfc0f779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-07a533a5-e7e8-4376-949c-9a00dfc0f779 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:35.630953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:35.632050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:35.633010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:35.637079 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 249/496] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:35.637928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a533a5-e7e8-4376-949c-9a00dfc0f779 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.689644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7c2cc-cca3-49ec-bafa-697c6572f659 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.725864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.726607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.726894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.727175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.735601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.737047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.748846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a533a5-e7e8-4376-949c-9a00dfc0f779 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:35.752046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:35.752924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:35.753815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 248/497] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:35.754409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.759584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:35.788644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43b27d-e850-478c-93d4-5ef1b4beb65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.789317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b27d-e850-478c-93d4-5ef1b4beb65c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.789604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b27d-e850-478c-93d4-5ef1b4beb65c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.789886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43b27d-e850-478c-93d4-5ef1b4beb65c None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.790760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43b27d-e850-478c-93d4-5ef1b4beb65c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:35.791074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43b27d-e850-478c-93d4-5ef1b4beb65c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.792501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43b27d-e850-478c-93d4-5ef1b4beb65c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.815668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:35.832277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 250/498] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:35.833669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0852a6-8bf8-4850-9d45-710c498d34da None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.833963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0852a6-8bf8-4850-9d45-710c498d34da None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.836693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0852a6-8bf8-4850-9d45-710c498d34da None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.836693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 251/499] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:35.836693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0852a6-8bf8-4850-9d45-710c498d34da None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.874314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5374f-ca29-4537-a3d0-060c383a3e9b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.907991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b5882-ce38-4423-8fe9-1168d7ddee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.908706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5882-ce38-4423-8fe9-1168d7ddee4b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.908991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5882-ce38-4423-8fe9-1168d7ddee4b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.909293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5882-ce38-4423-8fe9-1168d7ddee4b None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.910190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b5882-ce38-4423-8fe9-1168d7ddee4b None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:35.910500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b5882-ce38-4423-8fe9-1168d7ddee4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.911861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b5882-ce38-4423-8fe9-1168d7ddee4b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.920312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 249/500] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:35.921680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557849d-e804-4740-bbcd-e5e924e580b1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.921972 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557849d-e804-4740-bbcd-e5e924e580b1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.922274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557849d-e804-4740-bbcd-e5e924e580b1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.923503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 250/501] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:35.924195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557849d-e804-4740-bbcd-e5e924e580b1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:35.941870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0852a6-8bf8-4850-9d45-710c498d34da None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:35.975292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442b0bf-25a6-4482-85ae-589629b3514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:35.976008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442b0bf-25a6-4482-85ae-589629b3514c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.976235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442b0bf-25a6-4482-85ae-589629b3514c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.976507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442b0bf-25a6-4482-85ae-589629b3514c None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:35.977331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442b0bf-25a6-4482-85ae-589629b3514c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:35.977636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442b0bf-25a6-4482-85ae-589629b3514c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:35.979057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442b0bf-25a6-4482-85ae-589629b3514c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:35.996245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 252/502] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:35.997493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7966-8f30-41d7-af05-2a81702c29eb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:35.997891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7966-8f30-41d7-af05-2a81702c29eb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:35.998683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7966-8f30-41d7-af05-2a81702c29eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.014835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b25c7966-8f30-41d7-af05-2a81702c29eb None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:36.016037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b25c7966-8f30-41d7-af05-2a81702c29eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:36.025863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557849d-e804-4740-bbcd-e5e924e580b1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.033877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.039443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.059679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4459f-f4c3-4515-b6bb-85bb41e70a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.060334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4459f-f4c3-4515-b6bb-85bb41e70a40 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.060626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4459f-f4c3-4515-b6bb-85bb41e70a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.060937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4459f-f4c3-4515-b6bb-85bb41e70a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.083309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 253/503] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:36.084072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7966-8f30-41d7-af05-2a81702c29eb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.141225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4459f-f4c3-4515-b6bb-85bb41e70a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:36.142724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4459f-f4c3-4515-b6bb-85bb41e70a40 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:36.183256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7966-8f30-41d7-af05-2a81702c29eb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.218466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.219285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.219561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.219833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.229471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:36.230906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:36.240028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 251/504] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:36.241307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e06c-ebb6-45bc-b2ac-779b12109990 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.241593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e06c-ebb6-45bc-b2ac-779b12109990 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16e06c-ebb6-45bc-b2ac-779b12109990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:36.251410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:36.252258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:36.253114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:36.253114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:36.253114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:36.253114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:36.253114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 254/505] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:36.253763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.257269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.261188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1e16e06c-ebb6-45bc-b2ac-779b12109990 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:36.262412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1e16e06c-ebb6-45bc-b2ac-779b12109990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:36.270870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.328757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 252/506] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:36.329595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16e06c-ebb6-45bc-b2ac-779b12109990 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.363165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0efe0-9f00-4483-859b-41f2e998b01c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.396920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1d412-7214-4ad8-86cd-3d8dfdf00e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.397557 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d412-7214-4ad8-86cd-3d8dfdf00e6c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.397839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d412-7214-4ad8-86cd-3d8dfdf00e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.398136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1d412-7214-4ad8-86cd-3d8dfdf00e6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.429383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16e06c-ebb6-45bc-b2ac-779b12109990 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.462783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400ffb-cece-4d5c-9abd-3dcf81b39c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.463563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400ffb-cece-4d5c-9abd-3dcf81b39c19 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.463841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400ffb-cece-4d5c-9abd-3dcf81b39c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.464114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400ffb-cece-4d5c-9abd-3dcf81b39c19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.465235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1d412-7214-4ad8-86cd-3d8dfdf00e6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:36.467236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1d412-7214-4ad8-86cd-3d8dfdf00e6c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:36.469790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.474520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19400ffb-cece-4d5c-9abd-3dcf81b39c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-19400ffb-cece-4d5c-9abd-3dcf81b39c19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:36.482376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:36.483263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:36.484078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 253/507] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:36.484722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400ffb-cece-4d5c-9abd-3dcf81b39c19 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.487305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.570688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 255/508] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:36.570688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1d412-7214-4ad8-86cd-3d8dfdf00e6c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.582273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400ffb-cece-4d5c-9abd-3dcf81b39c19 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.615774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.616562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.616845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.617120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.627650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:36.629099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:36.646358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:36.647185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:36.648005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:36.648005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:36.648005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:36.648005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:36.648005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 254/509] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:36.648312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.670243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1d412-7214-4ad8-86cd-3d8dfdf00e6c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.672659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.703228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.703974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.704634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.704918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.705196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.705913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:36.706250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:36.707645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:36.719363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 256/510] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:36.719996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.747707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ce2a8-5d59-4d3b-9562-8fe9ecca3457 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.781275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.782053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.782366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.782638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.793610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:36.795111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:36.812715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:36.813747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:36.814692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:36.814692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:36.814692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:36.814692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:36.814692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 255/511] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:36.814945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.821169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093849e-7c2e-40fa-bbef-3babb3b30aa4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.856700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.857510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.858038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.858371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.859123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:36.859494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:36.860900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:36.868759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 257/512] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:36.869538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:36.897891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.917555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d868-1d78-47de-ae8e-96c0a47c8fdc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.925041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:36.953139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:36.953931 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:36.954258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:36.954546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:36.964815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:36.966296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:36.970957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526bb58-3a61-4a43-b7eb-4075a3ad8cf3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:36.983135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:36.983996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:36.984831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:36.984831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:36.984831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:36.984831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:36.984831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 256/513] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:36.985087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.007919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.008510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.008796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.009078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.009789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:37.010135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.011504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.024047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 258/514] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:37.024844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.087998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48715587-129d-4282-bfc1-4d9b80856323 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.108410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:37.121329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.122154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.122451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.122730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.123429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277eee8-9721-4da0-af5a-1015ec4b54b3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.130759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.132191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:37.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:37.148760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:37.149631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 257/515] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:37.150621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.168288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:37.168441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.169059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.169408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.170181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.170991 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:37.171283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.172635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.184362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 259/516] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:37.184975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.257089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35864a6-d6a6-44d0-88d7-5c5fd4ee902b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.284363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2474b-6f76-437f-8ace-54b7d28211cc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.290791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.291580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.291869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.292152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.302723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.304163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.318644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.319304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.319592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.319873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.320593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:37.320901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:37.322282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:37.323125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:37.324018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:37.324018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:37.324018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:37.324018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:37.324229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.324305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 258/517] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:37.324305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.338911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 260/518] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:37.339724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.348345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:37.397045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:37.430935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe218539-f66c-460f-b85a-1459137b4c12 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.443201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf583-472b-4b2e-ab75-b7c34b9ebc24 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.464150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.464937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.465223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.465499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.472354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.473790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.476511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.477166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.477446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.477720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.478577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:37.478883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.480280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:37.488887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:37.489737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:37.490622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 259/519] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:37.491088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.500531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 261/520] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:37.501360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.562663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:37.596337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad785ea-acdd-4944-a182-30dc627dbcee None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.600733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d50de-4ce0-429e-92d9-10c0b880188c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.625655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:37.631497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5c87-2104-449d-aea0-9c76fc6885e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.632163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5c87-2104-449d-aea0-9c76fc6885e4 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.632449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5c87-2104-449d-aea0-9c76fc6885e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.632725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e5c87-2104-449d-aea0-9c76fc6885e4 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.633422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e5c87-2104-449d-aea0-9c76fc6885e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.634888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e5c87-2104-449d-aea0-9c76fc6885e4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.635458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.636137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.636417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.636689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.637404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:37.637710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.639611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.650717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 262/521] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:37.651575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.702981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 260/522] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:42:37 2022] POST /identity/v3/users => generated 247 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:37.703817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5c87-2104-449d-aea0-9c76fc6885e4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.762350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ae5e5-9769-4d5b-b01f-1bf2673d8c59 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.789470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:37.802689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.803499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.803782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.804132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.811886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.813413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.817321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e5c87-2104-449d-aea0-9c76fc6885e4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:37.831316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:37.832221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:37.833064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 263/523] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:37.833621 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.865997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:37.866701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:37.866986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:37.867262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:37.868058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:37.868370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:37.869785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:37.889897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 261/524] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:37.890915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:37.946283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:37.964777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf5f81-9d9f-4207-9367-9edb54d54a5d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.002403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac19747-6202-491e-99c5-ec4207fe2cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.003061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19747-6202-491e-99c5-ec4207fe2cfb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.003266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e9376-e72f-4132-8165-95aadfa00d7d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.003366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19747-6202-491e-99c5-ec4207fe2cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.003605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac19747-6202-491e-99c5-ec4207fe2cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.040750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.041540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.041819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.042114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.050765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.052212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:38.058906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:38.073282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:38.074322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 262/525] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:38.075530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:38.080680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac19747-6202-491e-99c5-ec4207fe2cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.082349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac19747-6202-491e-99c5-ec4207fe2cfb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:38.181740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8577adb-dd9a-4267-84f2-4f02921a063d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.194306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 264/526] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:38.194306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac19747-6202-491e-99c5-ec4207fe2cfb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:38.196026 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:38.224709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.225364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.225645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.225919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.226728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:38.227114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.228581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:38.243236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 263/527] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:38.244089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:38.287492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:38.302543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac19747-6202-491e-99c5-ec4207fe2cfb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.338111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.338683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.338971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.339248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.340079 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=4ade274e49f748ee8e3bec2a963cf1b2) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:38.340395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.341941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:38.347088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3902ba-fa59-4aaa-8ac6-a04bf200e508 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.358317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 265/528] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:38 2022] GET /identity/v3/role_assignments?user.id=4ade274e49f748ee8e3bec2a963cf1b2&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:38.358317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:38.398633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.399403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.399756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.400100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.401051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:38.401495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.403159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:38.447436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 264/529] 10.222.0.36 () {56 vars in 1139 bytes} [Wed Jun 22 08:42:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:38.448556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:38.479112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:38.503403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3384b0-264c-48e3-b6f2-0086042ef8cf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.557117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.558477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.558820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.559156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.573660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.575484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdbe8b-36c2-439b-91e3-0a25bee9e34b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.576053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:38.588286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:38.601536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:38.602562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:38.603392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:38.603392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:38.603392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:38.603392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:38.606138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 266/530] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:38.607826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:38.623824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.624560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.624911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.625253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.626273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=bb36ac7a2e4643009bc1b0ca599203f3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:38.626677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.628219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:38.634651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 265/531] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:38 2022] GET /identity/v3/role_assignments?user.id=bb36ac7a2e4643009bc1b0ca599203f3&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:38.635656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:38.723595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22192bc-d2bc-44d1-ba51-4764d6bc4366 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.731546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:38.751317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9eafc7-e06e-4c4a-837f-4c6252d5c9a8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:38.804526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e805cfb-3efe-430f-bb96-1b253029a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.805205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e805cfb-3efe-430f-bb96-1b253029a830 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.805492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e805cfb-3efe-430f-bb96-1b253029a830 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.805838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e805cfb-3efe-430f-bb96-1b253029a830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.836326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:38.837054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:38.837439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:38.837600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:38.838863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:38.838863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.842126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:38.862154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 266/532] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:38.868324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:38.940136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:38.948986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e805cfb-3efe-430f-bb96-1b253029a830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:38.951377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e805cfb-3efe-430f-bb96-1b253029a830 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:39.002484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c467a3-c086-48a6-9a82-8ec94c47f3e3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:39.052666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:39.053466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:39.053747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:39.054025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:39.068891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:39.076774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:39.104980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:39.105837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:39.106737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:39.106737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:39.106737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:39.106737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:39.106737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:39.106737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:39.106737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:39.106737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:39.110079 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 267/533] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:39.111951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 267/534] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:39.113282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e805cfb-3efe-430f-bb96-1b253029a830 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:39.119022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:39.139857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:39.266521 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38584814-3273-4ff6-b858-e86d8f266895 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:39.267887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:39.276149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e805cfb-3efe-430f-bb96-1b253029a830 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:39.310160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:39.311587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:39.312260 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:39.312830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:39.314279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:39.314800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:39.316453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:39.329935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 268/535] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:39.336282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:39.349488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:39.350643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:39.351157 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:39.351634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:39.363719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:39.365405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:39.384168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:39.385129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:39.385960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:39.385960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:39.385960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:39.385960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:39.388197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 268/536] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:39.398106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:39.474976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:39.509295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142bf93-707d-4068-9dd8-a6a68f0f0eb3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:39.510599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba23ec-554d-445e-96a7-3c83662850d5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:39.558780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:39.559454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:39.559740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:39.562830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:39.562830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=8b95f073ece04f57a0c27cd3f5dd00cd) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:39.562830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:39.563038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:39.563038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:39.563345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:39.563795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:39.564268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:39.565185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:39.565699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:39.567288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:39.574222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 269/537] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:39 2022] GET /identity/v3/role_assignments?user.id=8b95f073ece04f57a0c27cd3f5dd00cd&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:39.582230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 269/538] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:39.587658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:39.701414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979462f8-283a-45ca-b500-f6149f8e8cb6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:39.738858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:39.750578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:39.751646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:39.752078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:39.752498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:39.766686 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:39.768405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:39.795167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:39.796182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:39.797220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:39.797220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:39.797220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:39.797220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:39.797220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:39.797220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:39.797220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:39.797220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:39.799385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 270/539] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:39.804700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:39.846819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:39.977827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d41746-f484-4faf-9a54-f4f45b6991d6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:40.023658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f203021a-6c09-48bb-bd66-5c1666c52be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:40.024567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203021a-6c09-48bb-bd66-5c1666c52be4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:40.025012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203021a-6c09-48bb-bd66-5c1666c52be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:40.025431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f203021a-6c09-48bb-bd66-5c1666c52be4 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:40.026405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203021a-6c09-48bb-bd66-5c1666c52be4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:40.026857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203021a-6c09-48bb-bd66-5c1666c52be4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:40.028415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f203021a-6c09-48bb-bd66-5c1666c52be4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:40.047733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 270/540] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:40.055156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:40.151991 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883666f8-4728-4711-8b3c-fd0e90efcada None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:40.152309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883666f8-4728-4711-8b3c-fd0e90efcada None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:40.152556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883666f8-4728-4711-8b3c-fd0e90efcada None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:40.154182 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 271/541] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:40.160995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e89819-fdac-4bc7-8a07-5fec8b6b747c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:40.161285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e89819-fdac-4bc7-8a07-5fec8b6b747c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:40.161567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e89819-fdac-4bc7-8a07-5fec8b6b747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:40.197603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e7e89819-fdac-4bc7-8a07-5fec8b6b747c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:40.198831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e7e89819-fdac-4bc7-8a07-5fec8b6b747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:40.244732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77ec9e-3356-465c-9d98-0449d3b18ab1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:40.316644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:40.317300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:40.317584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:40.317862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:40.321298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=04a07eaeae594cc99cc07da7a4fc6b4f) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:40.321627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:40.323915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:40.337398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 271/542] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:40 2022] GET /identity/v3/role_assignments?user.id=04a07eaeae594cc99cc07da7a4fc6b4f&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:40.339487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 272/543] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:40.365929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:40.466265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:40.519569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55961412-4523-4d71-ae62-b3355e3b04e8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:40.559019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605c09-3586-4230-9529-6d087252ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:40.560416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605c09-3586-4230-9529-6d087252ab4a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:40.561165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605c09-3586-4230-9529-6d087252ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:40.561672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06605c09-3586-4230-9529-6d087252ab4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:40.572917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06605c09-3586-4230-9529-6d087252ab4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-06605c09-3586-4230-9529-6d087252ab4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:40.581999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:40.582933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:40.583723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:40.586426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 272/544] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:40.599174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e89819-fdac-4bc7-8a07-5fec8b6b747c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:40.601389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:40.755238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e89819-fdac-4bc7-8a07-5fec8b6b747c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:40.812016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:40.813047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:40.813552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:40.814045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:40.815017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:40.815523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:40.817082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:40.827518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 273/545] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:40.833427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605c09-3586-4230-9529-6d087252ab4a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:40.962671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06605c09-3586-4230-9529-6d087252ab4a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:40.989367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:41.019375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33489734-56ff-4eef-b220-04fd35c1c518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:41.020578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33489734-56ff-4eef-b220-04fd35c1c518 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.021091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33489734-56ff-4eef-b220-04fd35c1c518 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.022592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33489734-56ff-4eef-b220-04fd35c1c518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.041983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33489734-56ff-4eef-b220-04fd35c1c518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:41.043811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33489734-56ff-4eef-b220-04fd35c1c518 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-33489734-56ff-4eef-b220-04fd35c1c518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:41.067886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:41.068767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:41.069683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:41.069683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:41.069683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:41.069683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:41.071692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 273/546] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:41.077748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:41.101535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7553-8834-4a4e-84ba-86acd7338e86 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.102241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7553-8834-4a4e-84ba-86acd7338e86 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.102720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a7553-8834-4a4e-84ba-86acd7338e86 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.104533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 274/547] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:42:41.111018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908994-be57-4042-bd2e-711465e41241 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.111570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908994-be57-4042-bd2e-711465e41241 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.112075 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908994-be57-4042-bd2e-711465e41241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.142008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5f908994-be57-4042-bd2e-711465e41241 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:41.143742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5f908994-be57-4042-bd2e-711465e41241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:41.202166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:41.241914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 275/548] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:41.250843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091bf71-a8e4-438a-b064-571e646326a6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:41.252611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da80b8-4d39-477c-bb0b-d590f54aa744 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.253129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da80b8-4d39-477c-bb0b-d590f54aa744 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.254556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da80b8-4d39-477c-bb0b-d590f54aa744 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.256242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 276/549] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:41.271202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da80b8-4d39-477c-bb0b-d590f54aa744 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:41.292415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3abc9-b342-4dfa-83bc-12dcc2f499b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:41.293275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3abc9-b342-4dfa-83bc-12dcc2f499b1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.293385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3abc9-b342-4dfa-83bc-12dcc2f499b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.293624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3abc9-b342-4dfa-83bc-12dcc2f499b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.294376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3abc9-b342-4dfa-83bc-12dcc2f499b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:41.295232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3abc9-b342-4dfa-83bc-12dcc2f499b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:41.296613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3abc9-b342-4dfa-83bc-12dcc2f499b1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:41.310093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 274/550] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:41.312070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97d9d1-9958-475f-89b0-6edf661330a2 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.312564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97d9d1-9958-475f-89b0-6edf661330a2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.313134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97d9d1-9958-475f-89b0-6edf661330a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.332908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0d97d9d1-9958-475f-89b0-6edf661330a2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:41.334088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0d97d9d1-9958-475f-89b0-6edf661330a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:41.389911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:41.395910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da80b8-4d39-477c-bb0b-d590f54aa744 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:41.405325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 275/551] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:41.411103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97d9d1-9958-475f-89b0-6edf661330a2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:41.437797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d63dd-978f-4060-92d8-7e0fc74f0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:41.440236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d63dd-978f-4060-92d8-7e0fc74f0c3d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.440745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d63dd-978f-4060-92d8-7e0fc74f0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.441285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d63dd-978f-4060-92d8-7e0fc74f0c3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.459857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d63dd-978f-4060-92d8-7e0fc74f0c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-532d63dd-978f-4060-92d8-7e0fc74f0c3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:41.469510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:41.470463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:41.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:41.474172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 277/552] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:41.475164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d63dd-978f-4060-92d8-7e0fc74f0c3d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:41.497489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:41.557668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97d9d1-9958-475f-89b0-6edf661330a2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:41.600650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:41.601371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.601646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.601915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.621065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:41.624378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:41.646404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:41.647386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:42:41.648291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:41.648804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d63dd-978f-4060-92d8-7e0fc74f0c3d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:41.652648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 276/553] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:41.654612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:41.696413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382317d-b09d-4133-8036-201f022d14d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:41.697738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382317d-b09d-4133-8036-201f022d14d6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.698025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382317d-b09d-4133-8036-201f022d14d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.698341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382317d-b09d-4133-8036-201f022d14d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.713111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382317d-b09d-4133-8036-201f022d14d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7382317d-b09d-4133-8036-201f022d14d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:41.724538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:41.726415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:41.727585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:41.734093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 278/554] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:41.734093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382317d-b09d-4133-8036-201f022d14d6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:41.759884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:41.770937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5fb0b-7f52-49c3-9080-5c28cbe52413 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:41.786632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:41.816232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:41.816907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.817195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.817474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.818249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:41.818556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:41.821654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:41.837102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 277/555] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:41.837302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:41.874970 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382317d-b09d-4133-8036-201f022d14d6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:41.912459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:41.913568 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:41.914195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:41.914644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:41.915653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:41.916227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:41.917960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:41.942206 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 279/556] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 22 08:42:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:41.943356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:41.966017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee75c0-bd62-4a96-8831-83280ed2be7f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.002489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.003158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.003451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.003714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.004606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:42.004873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.006367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.020387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 278/557] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:42.021371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.033189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:42.056550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b8c9a-4f85-42ba-bc2f-83225efea6c7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.066048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:42.092684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9a454-5690-48c9-971c-0e57e85bc037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.093532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a454-5690-48c9-971c-0e57e85bc037 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.093817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a454-5690-48c9-971c-0e57e85bc037 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.094114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9a454-5690-48c9-971c-0e57e85bc037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.104168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a454-5690-48c9-971c-0e57e85bc037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.105612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9a454-5690-48c9-971c-0e57e85bc037 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-2ec9a454-5690-48c9-971c-0e57e85bc037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:42.124353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:42.125841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:42.126817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:42.126817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:42.126817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:42.126817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:42.126817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 280/558] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:42.127087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88b4cb-69cd-4e7b-8b14-d421097e9f06 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.127313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88b4cb-69cd-4e7b-8b14-d421097e9f06 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.127593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88b4cb-69cd-4e7b-8b14-d421097e9f06 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.129014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 281/559] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:42.133654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88b4cb-69cd-4e7b-8b14-d421097e9f06 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.137862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05cf46-a0e1-417e-b421-906a426a86a5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.174730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbb1e3-cf61-40b3-af3d-70c161a0f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.175385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbb1e3-cf61-40b3-af3d-70c161a0f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.175669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbb1e3-cf61-40b3-af3d-70c161a0f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.175943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbb1e3-cf61-40b3-af3d-70c161a0f1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.239081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88b4cb-69cd-4e7b-8b14-d421097e9f06 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.248221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbb1e3-cf61-40b3-af3d-70c161a0f1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.249982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbb1e3-cf61-40b3-af3d-70c161a0f1e1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.266181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:42.274502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.275452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.276475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.276475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.288218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.289659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.290661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:42.310024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:42.311321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:42.316711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:42.316711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:42.316711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:42.316711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:42.316711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 282/560] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:42.316711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.366663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 279/561] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:42.366663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e57cf-25e2-4900-b479-7d304de73a46 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.366663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e57cf-25e2-4900-b479-7d304de73a46 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.366663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e57cf-25e2-4900-b479-7d304de73a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.380862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d53e57cf-25e2-4900-b479-7d304de73a46 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:42.381989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d53e57cf-25e2-4900-b479-7d304de73a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:42.425522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c06e1-f1b9-44d9-9ff3-cf4da991bc05 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.454536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 280/562] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:42.455375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e57cf-25e2-4900-b479-7d304de73a46 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.479589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.480643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.481044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.481318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.482761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:42.483081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.484528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.496763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 283/563] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:42.502002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.541454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:42.543946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:42.580338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e57cf-25e2-4900-b479-7d304de73a46 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.604272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e59f46-3398-4a5e-9733-e1c93b5105b5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.616098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.616760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.617044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.617321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.618047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:42.618595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.619751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.632004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 281/564] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:42.632734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.640236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.641138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.641428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.641707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.651843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.653282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:42.672388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:42.673464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:42.674386 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:42.674386 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:42.674386 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:42.674386 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:42.674386 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 284/565] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:42.674651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.736337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e82a4f-bbea-444f-8176-81af7cfd9a09 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.762211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:42.768261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:42.770123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c0209-1ef3-4575-989f-59e8d5e9deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.770917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c0209-1ef3-4575-989f-59e8d5e9deff None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.773238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c0209-1ef3-4575-989f-59e8d5e9deff None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.773238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c0209-1ef3-4575-989f-59e8d5e9deff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.776599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaf1e3-ad61-489d-b97f-d561a1c01609 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.783226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c0209-1ef3-4575-989f-59e8d5e9deff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-740c0209-1ef3-4575-989f-59e8d5e9deff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:42.791634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:42.792585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:42.793649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 282/566] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:42.795549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167a52-a75c-44e3-96ad-42c6284933b9 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.795853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167a52-a75c-44e3-96ad-42c6284933b9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.796171 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167a52-a75c-44e3-96ad-42c6284933b9 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.797474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 283/567] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:42.798355 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167a52-a75c-44e3-96ad-42c6284933b9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.816529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.817315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.817597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.817870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.828296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.829754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:42.844046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:42.845208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 285/568] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:42.846195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.902985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167a52-a75c-44e3-96ad-42c6284933b9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.937488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.938306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.938592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.938872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.943460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b25f-6dff-4f9f-9113-66a64ca90bf9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:42.945892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.947338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:42.962296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:42.963223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 284/569] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:42.964370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:42.979021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21110a14-ad98-4e0c-b7ec-cd4a3c5c650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:42.979685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21110a14-ad98-4e0c-b7ec-cd4a3c5c650c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.979968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21110a14-ad98-4e0c-b7ec-cd4a3c5c650c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.980248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21110a14-ad98-4e0c-b7ec-cd4a3c5c650c None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:42.980973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21110a14-ad98-4e0c-b7ec-cd4a3c5c650c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:42.981282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21110a14-ad98-4e0c-b7ec-cd4a3c5c650c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:42.982708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21110a14-ad98-4e0c-b7ec-cd4a3c5c650c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:42.994443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 286/570] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:42.995622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631170c-18f1-44a1-84cc-5e3a9da320be None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:42.995908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631170c-18f1-44a1-84cc-5e3a9da320be None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:42.996182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631170c-18f1-44a1-84cc-5e3a9da320be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.012415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2631170c-18f1-44a1-84cc-5e3a9da320be None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:43.014186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2631170c-18f1-44a1-84cc-5e3a9da320be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:43.017705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.021449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.068611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c08c6b-a48f-4394-9099-3f9ec6ee6163 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.080774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 287/571] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:43.081613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631170c-18f1-44a1-84cc-5e3a9da320be None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.118996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.119787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.120078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.120361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.121107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:43.121427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.123383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.131283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 285/572] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:43.132073 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.180242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631170c-18f1-44a1-84cc-5e3a9da320be None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.213323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.214114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.214400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.214676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.215507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:43.215814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.217276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.230754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.233302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856736-f9af-4366-831e-eb3146318c20 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.234795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 288/573] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:43.235576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.244066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.269992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.270740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.271077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.271343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.272170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:43.272482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.274018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.291769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 286/574] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:43.292560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.343373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b31bee-66f4-4004-9072-0b2d523f3823 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.377801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.378612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.378885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.379165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.385605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.387067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.391100 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee648fb9-b073-4e32-857a-416501d391df None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:43.401298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:43.402325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 289/575] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:43.403741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.427963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53dda6-607d-4400-ad30-b2363d842b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.428760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53dda6-607d-4400-ad30-b2363d842b05 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.429048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53dda6-607d-4400-ad30-b2363d842b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.429326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53dda6-607d-4400-ad30-b2363d842b05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.440118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53dda6-607d-4400-ad30-b2363d842b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0b53dda6-607d-4400-ad30-b2363d842b05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:43.447815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:43.448916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 287/576] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:43.449835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53dda6-607d-4400-ad30-b2363d842b05 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.469403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.478205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.511817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4d3e9-ab60-4ca3-994d-a2b0b201316a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.546459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.547310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.547529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.547808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.552499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53dda6-607d-4400-ad30-b2363d842b05 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.558346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.560447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:43.576966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:43.577943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:43.579051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:43.579051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:43.579051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:43.579051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:43.579051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 290/577] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:43.579327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.589954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.590922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.591703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.591974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.605081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.606558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:43.624310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:43.625212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:43.626107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:43.626107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:43.626107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:43.626107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:43.626107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 288/578] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:43.626400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.705381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea13360-e11d-422a-bd79-2d00b7f99a71 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.709376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.719216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.728489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc276af0-a347-4e8c-98d9-24e735e652c5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.741602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.742436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.742731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.743008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.757098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.758624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.765953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.766686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.766976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.767257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.768053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:43.768395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.769815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:43.779447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:43.780428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:43.781314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:43.781314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:43.781314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:43.781314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:43.781314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 291/579] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:43.782300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.790128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 289/580] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:43.790128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.887587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f4caf-94fb-4a60-a732-ba1a0d622b37 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.904395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc368b2-3099-4e38-864e-6074217418f0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:43.926444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.927130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.927411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.927687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.928444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:43.928755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.930372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.938628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 292/581] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:43.939371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.945140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:43.945810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:43.946116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:43.946395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:43.947122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:43.947426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:43.948793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:43.957969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:43.961633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 290/582] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:43.962998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:43.969144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:44.048855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3e08-2a9d-4501-b146-8ed00ec3f591 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.069008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fd45e-38f1-4520-a86c-5c3831befe1b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.084607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.085283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.085579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.085860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.086618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:44.086927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.088288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.104871 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 293/583] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:44.104871 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.107161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.107964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.108248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.108522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.109247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:44.109552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.110937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.123538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 291/584] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:44.124334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.192127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:44.202697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:44.219494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15356b8-7a3f-43e5-8e41-11538da709c3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.238498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64cecd-713b-4e30-b1be-f6092e3c6ccd None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.255646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.256308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.256593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.256869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.257706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=05a163118f6f44fdbad0c7c889970a7c) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:44.258014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.259489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.265765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 294/585] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/role_assignments?user.id=05a163118f6f44fdbad0c7c889970a7c&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:44.267111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.289622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.290476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.290760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.291033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.304208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.305790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:44.327240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:44.328376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:44.329308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:44.329308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:44.329308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:44.329308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:44.329308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 292/586] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:44.330041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.394868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198e090-f7aa-4e2e-95ff-de4bb13661ea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.447629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.448435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.448725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.449005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.450441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3c8e-14ed-4fe6-a55a-d3a670c64805 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.459228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.461396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.467631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:44.482883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:44.483913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 295/587] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:44.484856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.494682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.495494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.495780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.496058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.502240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:44.505202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.507314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:44.523111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:44.524210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:44.525451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:44.525451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:44.525451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:44.525451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:44.525451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:44.525451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:44.525451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:44.525451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:44.528947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 293/588] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:44.529839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.603772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5fb34-285c-400b-ac42-3bfe4481dada None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.649712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211054cc-6a4e-460c-88a2-f08eda919341 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.650024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.650767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.651197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.651407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.658746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.660186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:44.674616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:44.675523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:44.676421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 296/589] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:44.676903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.694658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.695407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.695757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.696101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.696892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:44.697278 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.698725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.717133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 294/590] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:44.717133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.748665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:44.761867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:44.795890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6db4f4-b8ff-4fb5-94e1-bbfa7a9dcdf5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.829353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3341b80-9c0d-487c-9f54-865842062e14 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.835130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.835974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.836412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.836815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.837787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:44.838720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.840672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.860290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 297/591] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:44.862944 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.869018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:44.869685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:44.869967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:44.870300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:44.871096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:44.871408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:44.873496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:44.885745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 295/592] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:44.886454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:44.977879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd619486-1b39-4ff7-8038-3f7787fb9fe1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:44.990844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:44.999724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab29dce-a126-4abf-8256-fca8537db6cd None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:45.010024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:45.018249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:45.018911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:45.019194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:45.019464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:45.020247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:45.020552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:45.021974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:45.033989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 298/593] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:45.034822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:45.041158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:45.042170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:45.042456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:45.042735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:45.050810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:45.052343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:45.067959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:45.068916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:45.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 296/594] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:45.070474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:45.160457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78aafcf-a055-447f-a2a0-df15bce40751 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:45.210269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:45.211433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:45.211946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:45.212496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:45.217080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706126e-7e43-45c5-b332-ae540d2a8a62 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:45.230466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:45.235512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:45.251829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f844-df25-4863-9660-480bd5786081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:45.252642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f844-df25-4863-9660-480bd5786081 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:45.252921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f844-df25-4863-9660-480bd5786081 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:45.253200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54f844-df25-4863-9660-480bd5786081 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/4ade274e49f748ee8e3bec2a963cf1b2/roles/68ca8a82d7b444d49fc01a6ad1de267b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:45.255903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:45.256772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:45.257646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:45.257646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:45.257646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:45.257646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:45.261817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 299/595] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:45.262734 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:45.271358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54f844-df25-4863-9660-480bd5786081 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=4ade274e49f748ee8e3bec2a963cf1b2, role_id=68ca8a82d7b444d49fc01a6ad1de267b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:45.272840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54f844-df25-4863-9660-480bd5786081 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:45.308747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:45.354848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 297/596] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:42:45 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/4ade274e49f748ee8e3bec2a963cf1b2/roles/68ca8a82d7b444d49fc01a6ad1de267b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:45.355932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f844-df25-4863-9660-480bd5786081 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:45.360999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:45.400424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af96982-5183-4292-9eb1-3035525905e0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:45.465836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d03f-7780-430d-8e8c-527e7c7067bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:45.469763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d03f-7780-430d-8e8c-527e7c7067bc None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:45.470444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d03f-7780-430d-8e8c-527e7c7067bc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:45.470929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d03f-7780-430d-8e8c-527e7c7067bc None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/bb36ac7a2e4643009bc1b0ca599203f3/roles/68ca8a82d7b444d49fc01a6ad1de267b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:45.507520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516d03f-7780-430d-8e8c-527e7c7067bc None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=bb36ac7a2e4643009bc1b0ca599203f3, role_id=68ca8a82d7b444d49fc01a6ad1de267b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:45.508887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516d03f-7780-430d-8e8c-527e7c7067bc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:45.561040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54f844-df25-4863-9660-480bd5786081 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:45.588148 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 300/597] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:42:45 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/bb36ac7a2e4643009bc1b0ca599203f3/roles/68ca8a82d7b444d49fc01a6ad1de267b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:45.594223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d03f-7780-430d-8e8c-527e7c7067bc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:45.616158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:45.617798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:45.618262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:45.619877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:45.621740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:45.622456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:45.624881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:45.664799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 298/598] 10.222.0.36 () {56 vars in 1139 bytes} [Wed Jun 22 08:42:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:45.672877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:45.792157 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:45.796131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:45.813524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d03f-7780-430d-8e8c-527e7c7067bc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:45.844778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c44de-6e8f-46e8-acb1-0c4731edb365 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:45.864125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:45.864987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:45.868228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:45.868228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:45.868228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:45.868228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:45.868787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:45.884142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 301/599] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:45.889715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:45.896610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:45.897635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:45.898294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:45.899648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:45.916869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:45.918573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:45.957791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:45.958939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:45.960028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:45.960028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:45.960028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:45.960028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:45.960028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 299/600] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:45.967857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:46.031338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767fefb-751d-431a-a926-2fdacfe5f995 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:46.068699 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:46.069796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.070249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.070669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.078593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:46.080218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:46.097030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:46.098131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:46.099234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:46.099234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:46.099234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:46.099234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:46.099234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:46.099234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:46.099234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:46.099234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:46.101445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 302/601] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:46.112580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:46.131597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:46.176473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593630e5-2b8c-4994-a0c7-2d14ff7bfd7d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:46.199634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:46.218100 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:46.219617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.220055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.220482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.221670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:46.222165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:46.223951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:46.238341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 300/602] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:46.248552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:46.284571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809e14-1ef8-403b-9e0b-9fdecba7857c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:46.351009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:46.351783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.352161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.352538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.353435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:46.353850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:46.355409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:46.377327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394e67-12d1-47f6-81e2-f99395448f62 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:46.386132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 303/603] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:46.392672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:46.468100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:46.486778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fc78d-e53e-413a-8ac9-068f5494f225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:46.487589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc78d-e53e-413a-8ac9-068f5494f225 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.487868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc78d-e53e-413a-8ac9-068f5494f225 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.488138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fc78d-e53e-413a-8ac9-068f5494f225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.495921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fc78d-e53e-413a-8ac9-068f5494f225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:46.497968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fc78d-e53e-413a-8ac9-068f5494f225 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:46.502414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ad0e2-d23d-4e22-995f-0e67888e8786 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-254fc78d-e53e-413a-8ac9-068f5494f225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:46.512371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:46.514341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:46.515757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 301/604] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:46.516902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69bfc7-1184-4937-95af-be886396fc3e None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.516902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69bfc7-1184-4937-95af-be886396fc3e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.516902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69bfc7-1184-4937-95af-be886396fc3e None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.521874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 302/605] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:46.522708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69bfc7-1184-4937-95af-be886396fc3e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:46.552442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb867da-59e9-4d06-b1f1-1a0e85e024e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:46.553600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb867da-59e9-4d06-b1f1-1a0e85e024e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.553909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb867da-59e9-4d06-b1f1-1a0e85e024e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.554500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb867da-59e9-4d06-b1f1-1a0e85e024e0 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/8b95f073ece04f57a0c27cd3f5dd00cd/roles/68ca8a82d7b444d49fc01a6ad1de267b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.555447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:46.577023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb867da-59e9-4d06-b1f1-1a0e85e024e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=8b95f073ece04f57a0c27cd3f5dd00cd, role_id=68ca8a82d7b444d49fc01a6ad1de267b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:46.578560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb867da-59e9-4d06-b1f1-1a0e85e024e0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:46.631475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69bfc7-1184-4937-95af-be886396fc3e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:46.666088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 304/606] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:42:46 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/8b95f073ece04f57a0c27cd3f5dd00cd/roles/68ca8a82d7b444d49fc01a6ad1de267b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:46.668661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:46.669035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961e924-72fd-4aec-9b9b-15ec403c745f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.669433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.669717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.669995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.670117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961e924-72fd-4aec-9b9b-15ec403c745f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.670713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961e924-72fd-4aec-9b9b-15ec403c745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.670890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:46.671170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:46.672741 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:46.688142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 303/607] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:46.699254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:46.699992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5961e924-72fd-4aec-9b9b-15ec403c745f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:46.702432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5961e924-72fd-4aec-9b9b-15ec403c745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:46.793451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 305/608] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:46.838394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961e924-72fd-4aec-9b9b-15ec403c745f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:46.885687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:46.895931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa2261-9aea-4e5d-a612-2ada2bf76ac3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:46.911844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:46.943882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0e33a-c987-454d-9406-4b6bafdcc155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:46.945302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0e33a-c987-454d-9406-4b6bafdcc155 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:46.945664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0e33a-c987-454d-9406-4b6bafdcc155 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:46.946013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0e33a-c987-454d-9406-4b6bafdcc155 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/04a07eaeae594cc99cc07da7a4fc6b4f/roles/68ca8a82d7b444d49fc01a6ad1de267b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:46.967826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0e33a-c987-454d-9406-4b6bafdcc155 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=04a07eaeae594cc99cc07da7a4fc6b4f, role_id=68ca8a82d7b444d49fc01a6ad1de267b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:46.974364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0e33a-c987-454d-9406-4b6bafdcc155 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:46.974483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961e924-72fd-4aec-9b9b-15ec403c745f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:47.009024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed4aed-3961-49a6-9548-a423cc58a435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:47.010268 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed4aed-3961-49a6-9548-a423cc58a435 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.010863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed4aed-3961-49a6-9548-a423cc58a435 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.011356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed4aed-3961-49a6-9548-a423cc58a435 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:47.024257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed4aed-3961-49a6-9548-a423cc58a435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-aaed4aed-3961-49a6-9548-a423cc58a435 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:47.034145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:47.035130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:47.035978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:47.038775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 306/609] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:47.047663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed4aed-3961-49a6-9548-a423cc58a435 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:47.060986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 304/610] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:42:46 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/04a07eaeae594cc99cc07da7a4fc6b4f/roles/68ca8a82d7b444d49fc01a6ad1de267b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:47.175716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed4aed-3961-49a6-9548-a423cc58a435 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:47.189118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:47.219827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:47.221081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.221896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.222339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:47.223269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:47.223713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:47.225301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:47.239077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 307/611] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:47.245122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0e33a-c987-454d-9406-4b6bafdcc155 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:47.357826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0e33a-c987-454d-9406-4b6bafdcc155 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:47.399165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb273c-c9f4-467a-a2a0-5ac1c4a7b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:47.399967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb273c-c9f4-467a-a2a0-5ac1c4a7b28a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.400250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb273c-c9f4-467a-a2a0-5ac1c4a7b28a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.400523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb273c-c9f4-467a-a2a0-5ac1c4a7b28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:47.411690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb273c-c9f4-467a-a2a0-5ac1c4a7b28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:47.413138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb273c-c9f4-467a-a2a0-5ac1c4a7b28a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:47.415142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6edb273c-c9f4-467a-a2a0-5ac1c4a7b28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:47.432141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:47.433231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:47.434439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:47.434439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:47.434439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:47.434439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:47.434439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 305/612] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:47.442620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:47.590122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b9b7-0939-4ba4-b382-4caa4645e610 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:47.642300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:47.643210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.643635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.644078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:47.645000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:47.645454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:47.647017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:47.658810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa50e3-3bbb-4269-bbc2-dddb517c9f36 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.659327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa50e3-3bbb-4269-bbc2-dddb517c9f36 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.659406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa50e3-3bbb-4269-bbc2-dddb517c9f36 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:47.660959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 306/613] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:47.665845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6debd-424c-4b15-8f5b-809f5e5131b9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.666184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6debd-424c-4b15-8f5b-809f5e5131b9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.666467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6debd-424c-4b15-8f5b-809f5e5131b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:47.667354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 308/614] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:47.673667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:47.684339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0ad6debd-424c-4b15-8f5b-809f5e5131b9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:47.686197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0ad6debd-424c-4b15-8f5b-809f5e5131b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:47.720392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:47.817939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3f020-591b-47f9-a476-e0fc99b9ef10 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:47.836599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 307/615] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:47.862374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6debd-424c-4b15-8f5b-809f5e5131b9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:47.899500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:47.900295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:47.900581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:47.900853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:47.916707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:47.918167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:47.943491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:47.944427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:47.945354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 309/616] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:47.957170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.015795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6debd-424c-4b15-8f5b-809f5e5131b9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.040616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:48.063765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64b40-fcf3-45b5-91c8-88d9ff9295db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.064579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64b40-fcf3-45b5-91c8-88d9ff9295db None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.064858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64b40-fcf3-45b5-91c8-88d9ff9295db None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.065128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64b40-fcf3-45b5-91c8-88d9ff9295db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.081779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace5ac3-f706-467b-92d2-7ccc979e72e6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.088139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d64b40-fcf3-45b5-91c8-88d9ff9295db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:48.099976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-23d64b40-fcf3-45b5-91c8-88d9ff9295db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:48.102016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:48.104098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:48.106040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:48.107702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 308/617] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:48.113699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64b40-fcf3-45b5-91c8-88d9ff9295db None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.131758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.132439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.132728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.133006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.133854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:48.134190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:48.135623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:48.172199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 310/618] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 22 08:42:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:48.177356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.302941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64b40-fcf3-45b5-91c8-88d9ff9295db None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.354495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766deeff-613c-4fec-9307-a5a7c68a87e8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.365528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d201e9-ec30-4614-8b8e-8afd0494a58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.367668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d201e9-ec30-4614-8b8e-8afd0494a58b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.367668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d201e9-ec30-4614-8b8e-8afd0494a58b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.367668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d201e9-ec30-4614-8b8e-8afd0494a58b None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.367668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d201e9-ec30-4614-8b8e-8afd0494a58b None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:48.367977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d201e9-ec30-4614-8b8e-8afd0494a58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:48.369314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d201e9-ec30-4614-8b8e-8afd0494a58b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:48.382101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 309/619] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:48.382101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafe78a-c4c4-42d0-944d-04480aa1b424 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.382101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafe78a-c4c4-42d0-944d-04480aa1b424 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.382101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafe78a-c4c4-42d0-944d-04480aa1b424 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.382101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 310/620] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:48.383753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafe78a-c4c4-42d0-944d-04480aa1b424 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.402905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c59dea-be06-4c60-9c82-51700f7f9613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.404226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c59dea-be06-4c60-9c82-51700f7f9613 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.404567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c59dea-be06-4c60-9c82-51700f7f9613 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.404790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c59dea-be06-4c60-9c82-51700f7f9613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.415549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c59dea-be06-4c60-9c82-51700f7f9613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:48.416979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c59dea-be06-4c60-9c82-51700f7f9613 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e3c59dea-be06-4c60-9c82-51700f7f9613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:48.435516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:48.436476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:48.437357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:48.437357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:48.437357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:48.437357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:48.437357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 311/621] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:48.438357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5092ee-c268-4533-a777-bd82c98448ab None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.438646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5092ee-c268-4533-a777-bd82c98448ab None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.438925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5092ee-c268-4533-a777-bd82c98448ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.444200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:48.452044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:48.458229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ed5092ee-c268-4533-a777-bd82c98448ab None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:48.459422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ed5092ee-c268-4533-a777-bd82c98448ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:48.515432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafe78a-c4c4-42d0-944d-04480aa1b424 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.554443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 312/622] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:48.555363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5092ee-c268-4533-a777-bd82c98448ab None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.575462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.576396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.577849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.578259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.593555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:48.595172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:48.613330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:48.614299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:48.615186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:48.615186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:48.615186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:48.615186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:48.615186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 311/623] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:48.615908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.690560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5092ee-c268-4533-a777-bd82c98448ab None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.720707 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:48.724267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf9813-a428-4cf2-be87-bd6cf722ba4d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.725041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:48.730571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.732063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.732639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.733217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.734147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:48.739367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:48.739367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:48.749087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 313/624] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:48.750231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.760842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4026d7-ab1b-4b70-a0cb-d08283affa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.761540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4026d7-ab1b-4b70-a0cb-d08283affa80 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.761824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4026d7-ab1b-4b70-a0cb-d08283affa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.762139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4026d7-ab1b-4b70-a0cb-d08283affa80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.773353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4026d7-ab1b-4b70-a0cb-d08283affa80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8a4026d7-ab1b-4b70-a0cb-d08283affa80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:48.781847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:48.782981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:48.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:48.787914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 312/625] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:48.788775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4026d7-ab1b-4b70-a0cb-d08283affa80 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.870025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8132-6b00-4ebf-bd29-d1ca4fe7eceb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.906295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4026d7-ab1b-4b70-a0cb-d08283affa80 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:48.908881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.910190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.910687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.911173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.912099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:48.912604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:48.914304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:48.928160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 314/626] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:48.929342 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.946964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:48.947736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:48.948023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:48.948297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:48.956390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:48.957751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:48.973191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:48.974208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:48.975109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 313/627] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:48.975614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:48.994245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:48.996489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:49.046393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40483cfe-01c7-416c-afc5-38d1d9ec93e8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.084628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.085395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.085733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.085915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b55e3c-836d-46a1-8b95-c2d07ed06f9c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.086147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.087034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:49.087409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:49.089633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:49.102857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 315/628] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:49.102857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:49.128941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.130079 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.130567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.131065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.139781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:49.141453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:49.157842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:49.159023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:42:49.160192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:49.162404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 314/629] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:42:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:49.163339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:49.213070 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511eb35-1f7f-42ba-8d38-86cfef2eaff2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.231712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:49.249375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:49.255322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515ee16-9527-48af-970d-daa6fca56c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.255988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515ee16-9527-48af-970d-daa6fca56c48 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.256271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515ee16-9527-48af-970d-daa6fca56c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.256696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515ee16-9527-48af-970d-daa6fca56c48 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.257335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515ee16-9527-48af-970d-daa6fca56c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:49.257647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515ee16-9527-48af-970d-daa6fca56c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:49.259114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515ee16-9527-48af-970d-daa6fca56c48 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:49.271857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cacd2a-0156-4544-952e-cd460f380577 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.278154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 316/630] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:49.278154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f757617-db3b-4a9e-ac91-29bb58089359 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.278154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f757617-db3b-4a9e-ac91-29bb58089359 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.278154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f757617-db3b-4a9e-ac91-29bb58089359 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.278154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 317/631] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:49.278154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f757617-db3b-4a9e-ac91-29bb58089359 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:49.316599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.317383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.317847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.317971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.330370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:49.332148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:49.351272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:49.352150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:49.353026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:49.353026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:49.353026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:49.353026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:49.353026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 315/632] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:49.353306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:49.400745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f757617-db3b-4a9e-ac91-29bb58089359 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.439995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eec8a-9414-4004-9bc9-ed6588109405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.440914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eec8a-9414-4004-9bc9-ed6588109405 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.441195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eec8a-9414-4004-9bc9-ed6588109405 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.441476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eec8a-9414-4004-9bc9-ed6588109405 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.442345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eec8a-9414-4004-9bc9-ed6588109405 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:49.442658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eec8a-9414-4004-9bc9-ed6588109405 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:49.444076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696eec8a-9414-4004-9bc9-ed6588109405 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:49.457694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1c0f2-1414-4577-93c3-1313bfcd9755 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.468271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 318/633] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:42:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:49.468271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a130b-e630-4602-9692-f278d8997e59 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.468271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a130b-e630-4602-9692-f278d8997e59 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.468271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a130b-e630-4602-9692-f278d8997e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.484573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-be4a130b-e630-4602-9692-f278d8997e59 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:49.485865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-be4a130b-e630-4602-9692-f278d8997e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:49.491033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:49.496761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c15e4-b3ef-4275-9425-e9bdc7f22a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.497835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c15e4-b3ef-4275-9425-e9bdc7f22a40 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.498163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c15e4-b3ef-4275-9425-e9bdc7f22a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.502451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c15e4-b3ef-4275-9425-e9bdc7f22a40 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/05a163118f6f44fdbad0c7c889970a7c/roles/68ca8a82d7b444d49fc01a6ad1de267b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.515174 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:49.515335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c15e4-b3ef-4275-9425-e9bdc7f22a40 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=05a163118f6f44fdbad0c7c889970a7c, role_id=68ca8a82d7b444d49fc01a6ad1de267b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:49.516702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c15e4-b3ef-4275-9425-e9bdc7f22a40 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:49.556130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 319/634] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:49.557025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a130b-e630-4602-9692-f278d8997e59 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:49.583180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 316/635] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:42:49 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/05a163118f6f44fdbad0c7c889970a7c/roles/68ca8a82d7b444d49fc01a6ad1de267b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:42:49.583912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c15e4-b3ef-4275-9425-e9bdc7f22a40 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:49.668299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a130b-e630-4602-9692-f278d8997e59 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.694183 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c15e4-b3ef-4275-9425-e9bdc7f22a40 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.708679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d3ddd-5efe-462f-a0e2-7d99ffcbf642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.709467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d3ddd-5efe-462f-a0e2-7d99ffcbf642 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.709747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d3ddd-5efe-462f-a0e2-7d99ffcbf642 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.710018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d3ddd-5efe-462f-a0e2-7d99ffcbf642 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.710905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d3ddd-5efe-462f-a0e2-7d99ffcbf642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:49.711213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d3ddd-5efe-462f-a0e2-7d99ffcbf642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:49.712584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d3ddd-5efe-462f-a0e2-7d99ffcbf642 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:49.730725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 320/636] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:49.733155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5719-9c7c-4f8e-87c2-1842d7677631 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.733155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5719-9c7c-4f8e-87c2-1842d7677631 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.733418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5719-9c7c-4f8e-87c2-1842d7677631 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.738130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 321/637] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:49.738280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118ddad-d344-4152-9808-b46b6d0448b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.738712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5719-9c7c-4f8e-87c2-1842d7677631 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:49.738803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ddad-d344-4152-9808-b46b6d0448b6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.738803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ddad-d344-4152-9808-b46b6d0448b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.738803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ddad-d344-4152-9808-b46b6d0448b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.770136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:49.796394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:49.815866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118ddad-d344-4152-9808-b46b6d0448b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:49.817995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118ddad-d344-4152-9808-b46b6d0448b6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:49.860674 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5719-9c7c-4f8e-87c2-1842d7677631 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:49.896427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ad8b-1e5a-4d17-abee-6f4969468191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:49.897253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ad8b-1e5a-4d17-abee-6f4969468191 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.897545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ad8b-1e5a-4d17-abee-6f4969468191 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.897822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631ad8b-1e5a-4d17-abee-6f4969468191 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.908454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631ad8b-1e5a-4d17-abee-6f4969468191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a631ad8b-1e5a-4d17-abee-6f4969468191 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:49.916211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:49.917575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:49.918982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 322/638] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:49.924840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ad8b-1e5a-4d17-abee-6f4969468191 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:49.945583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 317/639] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:49.945583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7f36-4b7f-44cc-a881-dc7617356481 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:49.945583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7f36-4b7f-44cc-a881-dc7617356481 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:49.945583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f7f36-4b7f-44cc-a881-dc7617356481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:49.963308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a64f7f36-4b7f-44cc-a881-dc7617356481 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:49.964556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a64f7f36-4b7f-44cc-a881-dc7617356481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:50.024401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.042398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 318/640] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:50.042398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f7f36-4b7f-44cc-a881-dc7617356481 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.048849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631ad8b-1e5a-4d17-abee-6f4969468191 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.057561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.087670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.088477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.088765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.089044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.096770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.098264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:50.113708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:50.114932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 323/641] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:50.115967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.154962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f7f36-4b7f-44cc-a881-dc7617356481 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.191903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.192528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.192834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.193111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.193892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:50.194253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.195713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.203755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 319/642] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:50.204703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.228455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721ba22-7a7d-4117-ad40-32365bc4508b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.268417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.269213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.269497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.269773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.277905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.281042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.282537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.284372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:50.300975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:50.301983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:50.302901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:50.302901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:50.302901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:50.302901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:50.302901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 324/643] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:50.303824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.316775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196aa93-d5a7-4a7a-9c3c-acb69a21ce0b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.352299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ab9fd-9ed8-44d2-972a-9e35f57ed71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.353092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ab9fd-9ed8-44d2-972a-9e35f57ed71d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.353373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ab9fd-9ed8-44d2-972a-9e35f57ed71d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.353643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ab9fd-9ed8-44d2-972a-9e35f57ed71d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.364214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ab9fd-9ed8-44d2-972a-9e35f57ed71d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-fb8ab9fd-9ed8-44d2-972a-9e35f57ed71d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:50.371898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:50.373483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 320/644] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:50.374399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ab9fd-9ed8-44d2-972a-9e35f57ed71d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.413215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea231b-29c3-4b17-8164-459d4060017c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.447404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.448001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.448285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.448561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.449401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:50.449715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.451903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.474403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 325/645] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:50.475267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.476709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ab9fd-9ed8-44d2-972a-9e35f57ed71d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.510876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.516872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.518022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.518022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.518263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.528865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.536596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.536713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:50.547429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:50.548318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:50.549186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:50.549186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:50.549186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:50.549186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:50.549186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 321/646] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:50.549457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.588981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dc00a-cf45-4645-b831-304518c26319 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.624789 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.625555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.625853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.626200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.627053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:50.627361 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.628712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.642104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 326/647] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:50.642911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.663221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa4769-4316-4584-aab1-a0d51cc2ea9a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.702436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.703158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.703489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.703772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.704547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:50.704859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.706554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.721703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 322/648] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:50.721703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.754566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0b51b-39bb-48a1-85c4-49929bb652fc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.768500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.771204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.789649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a312-a9ed-4f2e-9b68-4293b549c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.790343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a312-a9ed-4f2e-9b68-4293b549c732 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.790632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a312-a9ed-4f2e-9b68-4293b549c732 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.790917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a312-a9ed-4f2e-9b68-4293b549c732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.828583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e05e0-64dc-411f-81e3-fc124213ed1a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:50.864928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:50.865678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:50.866033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:50.866412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:50.867206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:50.867580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.868715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6a312-a9ed-4f2e-9b68-4293b549c732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:50.869053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.870251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6a312-a9ed-4f2e-9b68-4293b549c732 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:50.881946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 323/649] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:50.887088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.970756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 327/650] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:50.972207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a312-a9ed-4f2e-9b68-4293b549c732 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:50.987191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:50.996228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261517a-6204-4098-a561-0d101fd5bc50 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.004792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.032260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.033070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.033352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.033625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.040322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.041851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:51.056654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:51.057606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:51.058545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 324/651] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:51.059046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.078794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a312-a9ed-4f2e-9b68-4293b549c732 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.116255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.117048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.117333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.117610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.128067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.129503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:51.149608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:51.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:51.151503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:51.151503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:51.151503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:51.151503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:51.151503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 328/652] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:51.151783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.176414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1c4e2-f495-463b-9eee-f94393d6eb91 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.213987 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.215145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.215422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.215694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.218563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.225144 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.226865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:51.241556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:51.247821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 325/653] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:51.249068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.263384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12fe4-f02d-4f9c-aa8a-06f2c0f91861 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.275678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.299845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.300726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.301014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.301288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.312485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.313935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:51.332155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:51.333145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:51.334040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:51.334040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:51.334040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:51.334040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:51.334040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 329/654] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:51.334939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.358845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2327b0c-1f89-422b-bfe5-1ef677f70bd1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.394454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.395109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.395502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.395776 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.396679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:51.396986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.398535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.415589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 326/655] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:51.415589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.442751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9200cd-24a6-4bfa-90b4-78aba7acd826 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.459333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.482067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.482757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.483039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.483327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.484225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:51.485012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.486781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.507510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 330/656] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:51.507695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.508406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.521834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b6ce-e852-4965-9fc7-b69539720dcd None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.558082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.563613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.563613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.563613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.563613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:51.563613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.563613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.580971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 327/657] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:51.582138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.623727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7544d54-58dd-4d77-97db-ee124e568cf2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.659707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.660367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.660648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.660922 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.661643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:51.661950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.663334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.674879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 331/658] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:51.675732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.687495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fc41a-88d9-41a0-b058-804ba3a434d0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.713934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.721131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.721788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.722177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.722465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.723296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=4ade274e49f748ee8e3bec2a963cf1b2) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:51.726538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.726538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.731026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 328/659] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/role_assignments?user.id=4ade274e49f748ee8e3bec2a963cf1b2&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:51.732415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.743286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.791013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18c964-fd43-47df-babb-024e633307fd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.837276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304b8e0-a0f2-49e7-bf89-66678df54255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.838129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b8e0-a0f2-49e7-bf89-66678df54255 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.838423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b8e0-a0f2-49e7-bf89-66678df54255 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.838703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304b8e0-a0f2-49e7-bf89-66678df54255 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.846862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b8e0-a0f2-49e7-bf89-66678df54255 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.848335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304b8e0-a0f2-49e7-bf89-66678df54255 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.853827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7b54-355c-442a-abf2-3b00faddace9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1304b8e0-a0f2-49e7-bf89-66678df54255 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:51.864078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:51.865107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:51.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 332/660] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:51.866954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bb9f-1293-4eea-a181-0fe3937a72ca None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.866954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bb9f-1293-4eea-a181-0fe3937a72ca None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.867262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1bb9f-1293-4eea-a181-0fe3937a72ca None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.868655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 333/661] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:51.874451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1bb9f-1293-4eea-a181-0fe3937a72ca None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:51.904738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07b687-3237-4c41-b034-321ee8c37bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:51.905399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b687-3237-4c41-b034-321ee8c37bea None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:51.905683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b687-3237-4c41-b034-321ee8c37bea None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:51.905960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07b687-3237-4c41-b034-321ee8c37bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:51.979623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b687-3237-4c41-b034-321ee8c37bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:51.981120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07b687-3237-4c41-b034-321ee8c37bea None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:51.986682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.992498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:51.995657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1bb9f-1293-4eea-a181-0fe3937a72ca None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.039130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.040532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.041182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.041969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.050097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:52.051533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:52.067999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:52.068987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:52.069900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 334/662] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:52.071300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.088694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 329/663] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:52.090394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6487c-da38-4698-a719-676901ce1e54 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.090779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6487c-da38-4698-a719-676901ce1e54 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.091232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6487c-da38-4698-a719-676901ce1e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.108802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0cf6487c-da38-4698-a719-676901ce1e54 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:52.110108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0cf6487c-da38-4698-a719-676901ce1e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:52.189599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8860df-f8b6-475b-a60d-33844a1b5521 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.193812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 330/664] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:52.198116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6487c-da38-4698-a719-676901ce1e54 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.235579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.236574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.237056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.237502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.238524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:52.238685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:52.238880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:52.240314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:52.265423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 335/665] 10.222.0.36 () {56 vars in 1139 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:52.265423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.284518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:52.303808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6487c-da38-4698-a719-676901ce1e54 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.338937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.339684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.340040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.340388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.342164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:52.342591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:52.344096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:52.360532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 331/666] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:52.360532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.383876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b7ed9-2b0f-4c4e-92b7-5597d8d62a69 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.424984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.425922 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.426539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.426913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.438712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:52.440144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:52.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:52.460799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:52.461855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:52.461855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:52.461855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:52.461855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:52.462530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 336/667] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:52.463306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.472490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:52.476333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda0371-dd99-459a-9651-2ef02c839946 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.513651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb922c1-dd38-4d2b-b24e-af9f869b6f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.514544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb922c1-dd38-4d2b-b24e-af9f869b6f0c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.514830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb922c1-dd38-4d2b-b24e-af9f869b6f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.515192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb922c1-dd38-4d2b-b24e-af9f869b6f0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.525636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb922c1-dd38-4d2b-b24e-af9f869b6f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ceb922c1-dd38-4d2b-b24e-af9f869b6f0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:52.534492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:52.535443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:52.536285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 332/668] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:52.537009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb922c1-dd38-4d2b-b24e-af9f869b6f0c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.538127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:52.577410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037de1-3195-4966-933a-d85bc6c247f1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.615441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc68ed-8307-4e76-8391-5ca78cb2c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.616233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc68ed-8307-4e76-8391-5ca78cb2c004 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.616619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc68ed-8307-4e76-8391-5ca78cb2c004 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.616993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc68ed-8307-4e76-8391-5ca78cb2c004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.644260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb922c1-dd38-4d2b-b24e-af9f869b6f0c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.679287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.680063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.680454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.680831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.681756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=bb36ac7a2e4643009bc1b0ca599203f3) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:52.682203 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:52.683712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:52.687938 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc68ed-8307-4e76-8391-5ca78cb2c004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:52.689453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc68ed-8307-4e76-8391-5ca78cb2c004 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:52.690308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 333/669] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/role_assignments?user.id=bb36ac7a2e4643009bc1b0ca599203f3&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:52.691033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.721003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:52.799771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:52.814744 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e3304-6b78-451f-9731-966be1ab67c4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.850646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 337/670] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:52.852078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc68ed-8307-4e76-8391-5ca78cb2c004 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.854496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:52.855576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:52.855788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:52.856165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:52.857910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:52.857910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:52.859115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:52.876415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 334/671] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:52.877494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:52.976078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:52.994212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc68ed-8307-4e76-8391-5ca78cb2c004 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:52.998430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58caa8-9d6a-4413-ba72-5002568dd6c0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.035149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.036213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.036749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.037237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.037496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.038035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.038353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.038630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.039118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:53.039629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.041183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.049596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.054601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.054935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 338/672] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:53.056006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:53.069832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:53.070915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:53.072230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:53.072230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:53.072230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:53.072230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:53.072230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 335/673] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:53.072230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.090032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:53.166262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693b72d-decb-42b5-a18b-50c86aaa767a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.184629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03799cd8-3286-43b5-9a35-a9a545572a98 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.203482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.204634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.205118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.205593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.213129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.214830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.221694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.222544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.222830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.223101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.225053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:53.233034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:53.238376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:53.239720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:53.239720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:53.239720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:53.239720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:53.239720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:53.239720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:53.239720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:53.239720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:53.240151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.240225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 339/674] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:53.240225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.240379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:53.256053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:53.257195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:53.258276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:53.258276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:53.258276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:53.258276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:53.266320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 336/675] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:53.266320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.349319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:53.363257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aee22-93de-49ee-bb4b-0a08bf9cdc42 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.374192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1fcca-3549-4790-9f80-4aaffd62e01f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.401434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.402588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.403791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.404540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.405625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:53.406177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.407797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.411733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.412512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.412905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.413276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.414204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:53.414612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.416208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.422545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 340/676] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:53.423661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.434857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 337/677] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:53.436034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.496792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:53.554410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e41401-2e41-4e57-8ecd-b623c3d57ea3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.567509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348db25-1913-4e7f-9d00-05b25fc43fd6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.598531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.599880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.600178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.600527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.601326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:53.601860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.603948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.612793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.614361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.614837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.615796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.623226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 341/678] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:53.623226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.629206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.631290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.632451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:53.650389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:53.656327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 338/679] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:53.657219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.735466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012b184-c41a-458d-a5c2-8d68e71b864b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.783213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.783967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.784325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.784670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.785575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=8b95f073ece04f57a0c27cd3f5dd00cd) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:53.785956 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.786957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f66e5-0617-45ad-a8bd-17f992aea376 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:53.787572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.794935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 342/680] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/role_assignments?user.id=8b95f073ece04f57a0c27cd3f5dd00cd&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:53.796014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:53.796242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.838033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:53.839795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:53.840078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:53.840353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:53.860668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:53.862041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:53.888941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:53.890036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:42:53.890997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:53.892288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 339/681] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:53.899760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:53.919439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:53.960838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c087-af92-4e9e-ba67-31c493ffac06 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:54.006963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817a2f3-f09d-4721-bc2d-c9e28e1183fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:54.007692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a2f3-f09d-4721-bc2d-c9e28e1183fe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.007915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a2f3-f09d-4721-bc2d-c9e28e1183fe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.008195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a2f3-f09d-4721-bc2d-c9e28e1183fe None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.009012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817a2f3-f09d-4721-bc2d-c9e28e1183fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:54.009309 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817a2f3-f09d-4721-bc2d-c9e28e1183fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:54.010777 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817a2f3-f09d-4721-bc2d-c9e28e1183fe None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:54.029055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 343/682] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:54.030524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23a79f-c794-43e2-9012-fc42aac2b2d8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.030812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23a79f-c794-43e2-9012-fc42aac2b2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.031089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23a79f-c794-43e2-9012-fc42aac2b2d8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.032476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 344/683] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:54.035253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23a79f-c794-43e2-9012-fc42aac2b2d8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:54.060170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a68b82-48c4-484d-9ec9-5f98edaab9c6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:54.101370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d1c63-a7ef-4317-8d2a-a5bf6c56836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:54.102421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1c63-a7ef-4317-8d2a-a5bf6c56836f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.102886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1c63-a7ef-4317-8d2a-a5bf6c56836f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.103365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1c63-a7ef-4317-8d2a-a5bf6c56836f None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.104545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d1c63-a7ef-4317-8d2a-a5bf6c56836f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:54.105034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d1c63-a7ef-4317-8d2a-a5bf6c56836f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:54.107126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d1c63-a7ef-4317-8d2a-a5bf6c56836f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:54.127151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 340/684] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 22 08:42:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:54.128851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53ba0-6ed0-4af0-ac17-20d6023f673e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.129325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53ba0-6ed0-4af0-ac17-20d6023f673e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.129820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb53ba0-6ed0-4af0-ac17-20d6023f673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.148957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bfb53ba0-6ed0-4af0-ac17-20d6023f673e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:54.150181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bfb53ba0-6ed0-4af0-ac17-20d6023f673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:54.168134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23a79f-c794-43e2-9012-fc42aac2b2d8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:54.170835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:54.208278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:54.213589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:54.214690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.215009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.217912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.217912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=04a07eaeae594cc99cc07da7a4fc6b4f) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:54.217912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:54.218443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:54.234095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 345/685] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:54 2022] GET /identity/v3/role_assignments?user.id=04a07eaeae594cc99cc07da7a4fc6b4f&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:54.234095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:54.237450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 341/686] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:54.275455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb53ba0-6ed0-4af0-ac17-20d6023f673e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:54.346817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b0085-ec27-48fa-92e1-3c9a5563e91e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:54.387477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c8869-4ee8-44aa-bb7b-deef21ca2c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:54.388559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c8869-4ee8-44aa-bb7b-deef21ca2c3e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.388855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c8869-4ee8-44aa-bb7b-deef21ca2c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.389137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c8869-4ee8-44aa-bb7b-deef21ca2c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.465836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:54.482670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c8869-4ee8-44aa-bb7b-deef21ca2c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:54.484253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c8869-4ee8-44aa-bb7b-deef21ca2c3e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:54.486423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb53ba0-6ed0-4af0-ac17-20d6023f673e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:54.532693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49330efd-cd5b-423c-99d8-c60019acd180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:54.533668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49330efd-cd5b-423c-99d8-c60019acd180 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.534049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49330efd-cd5b-423c-99d8-c60019acd180 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.534457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49330efd-cd5b-423c-99d8-c60019acd180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.549175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49330efd-cd5b-423c-99d8-c60019acd180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-49330efd-cd5b-423c-99d8-c60019acd180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:54.559135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:54.567873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 342/687] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:54.568849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49330efd-cd5b-423c-99d8-c60019acd180 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:54.590441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:54.616544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 346/688] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:54.624037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c8869-4ee8-44aa-bb7b-deef21ca2c3e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:54.703460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49330efd-cd5b-423c-99d8-c60019acd180 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:54.749352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:54.758084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.758084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.758084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.758084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:54.758084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:54.758084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:54.770550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:54.772342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 343/689] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:54.774223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c8869-4ee8-44aa-bb7b-deef21ca2c3e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:54.779039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:54.842637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:54.843447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.843840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.844015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.867145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:54.868608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:54.891200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:54.892138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:54.897786 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:54.897786 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:54.897786 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:54.897786 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:54.897786 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 347/690] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:54.898298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:54.923705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:54.947812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95179b-d780-4481-82bc-6759dc50f39a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:54.984810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e5da6-d7ce-46ba-bf90-846e3bf7d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:54.985949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e5da6-d7ce-46ba-bf90-846e3bf7d2fa None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:54.986491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e5da6-d7ce-46ba-bf90-846e3bf7d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:54.986969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e5da6-d7ce-46ba-bf90-846e3bf7d2fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:54.998506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e5da6-d7ce-46ba-bf90-846e3bf7d2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.000293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e5da6-d7ce-46ba-bf90-846e3bf7d2fa None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.007961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ebe3f-531c-41e2-ac36-39bbb0aed784 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b38e5da6-d7ce-46ba-bf90-846e3bf7d2fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:55.019519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:55.020467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:55.021456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:55.021456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:55.021456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:55.021456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:55.023791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 344/691] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:55.025320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef9a39-23e6-41e0-9356-6f98663567cb None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.025824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef9a39-23e6-41e0-9356-6f98663567cb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.026359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef9a39-23e6-41e0-9356-6f98663567cb None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.028597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 345/692] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:55.034198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734aea-0e6f-464a-afc4-552ad5341d4c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.034679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734aea-0e6f-464a-afc4-552ad5341d4c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.035325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734aea-0e6f-464a-afc4-552ad5341d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.049462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.050168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.050573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.050855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.051591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:55.051902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.053273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.057336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5e734aea-0e6f-464a-afc4-552ad5341d4c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:55.058810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5e734aea-0e6f-464a-afc4-552ad5341d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:55.065554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 348/693] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:55.066473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.080635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:55.156457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 346/694] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:55.157754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e734aea-0e6f-464a-afc4-552ad5341d4c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.205040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299cde-ee46-4298-9508-a08f97fbdc77 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.230973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:55.249959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.250582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.250867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.251146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.251881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:55.252190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.254035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.275086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 349/695] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:55.275086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.285981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e734aea-0e6f-464a-afc4-552ad5341d4c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.322665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.323705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.324141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.324566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.332624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.334352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:55.349737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:55.350877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:55.351834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:55.351834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:55.351834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:55.351834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:55.351834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:55.351834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:55.351834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:55.351834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:55.353035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:55.354455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 347/696] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:55.355500 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.397541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d4cf1-6375-4060-8640-3ba3d0d36bee None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.443326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.444390 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.444677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.444954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.459509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.461682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:55.482205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:55.483084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:55.483969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:55.483969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:55.483969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:55.483969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:55.490092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bf91e-c38c-4c6a-a7e6-c2c6dddc4f4b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.490592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 350/697] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:55.491606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.507845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:55.529585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.530854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.531373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.531856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.540728 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.542457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:42:55.557589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:55.566630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 348/698] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:55.567570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.618338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e3e0f-edbf-4621-ab34-b870197dfa6a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.641397 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:55.657561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.658262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.658550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.658830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.659624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:55.660498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.661949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.682201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 351/699] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:55.683353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.694958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f452a6-4d88-44c8-a7f4-026e997ab1c2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.736074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.736752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.737045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.737327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.738078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:55.738394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.739749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.757429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 349/700] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:55.757429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.800837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:55.803856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be8fe-3b4a-49e2-a6af-c06546a84887 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.841769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.842826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.843345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.844442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.845540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:55.846033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.847644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.871318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83019edd-9d21-4cac-907b-953195d039c6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:55.871610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 352/701] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:55.873196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.906586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:55.907264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:55.907545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:55.907843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:55.908668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=05a163118f6f44fdbad0c7c889970a7c) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:55.908984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:55.910440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:55.918007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:55.922194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 350/702] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/role_assignments?user.id=05a163118f6f44fdbad0c7c889970a7c&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:55.923159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:55.986804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460854d-d645-4521-ad18-956efbcb068c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:56.034234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a810-67f4-4210-ba9d-862841076cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:56.035768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a810-67f4-4210-ba9d-862841076cca None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.036301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a810-67f4-4210-ba9d-862841076cca None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.036807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a810-67f4-4210-ba9d-862841076cca None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.037723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a810-67f4-4210-ba9d-862841076cca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:56.039429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a810-67f4-4210-ba9d-862841076cca None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:56.104941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38f3c-f6a0-47e7-a2ce-b479cb25dc10 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:56.108812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:56.147533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9103f-66ea-44d3-9286-e965dbf5ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:56.148188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9103f-66ea-44d3-9286-e965dbf5ec27 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.148597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9103f-66ea-44d3-9286-e965dbf5ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.148878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9103f-66ea-44d3-9286-e965dbf5ec27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.167360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 353/703] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:42:55 2022] POST /identity/v3/users => generated 254 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:42:56.209524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7625a-d87d-40dc-95be-82454d1474b4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.209818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7625a-d87d-40dc-95be-82454d1474b4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.210172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7625a-d87d-40dc-95be-82454d1474b4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.211780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 354/704] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:42:56.218667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a067-3c40-4b1e-948a-62288bb9e956 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.218961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a067-3c40-4b1e-948a-62288bb9e956 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.219239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38a067-3c40-4b1e-948a-62288bb9e956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.234317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9103f-66ea-44d3-9286-e965dbf5ec27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:56.236198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9103f-66ea-44d3-9286-e965dbf5ec27 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:56.238719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6c38a067-3c40-4b1e-948a-62288bb9e956 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:56.240077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6c38a067-3c40-4b1e-948a-62288bb9e956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:56.327816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 355/705] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:56.352003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38a067-3c40-4b1e-948a-62288bb9e956 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:56.386144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:56.391333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 351/706] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:42:56.396584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9103f-66ea-44d3-9286-e965dbf5ec27 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:56.398684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:56.485349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38a067-3c40-4b1e-948a-62288bb9e956 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:56.527932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9103f-66ea-44d3-9286-e965dbf5ec27 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:56.532021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:56.533077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.533515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.533966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.534801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:56.536313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:56.553183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:56.554439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:42:56.555517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:56.558400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 356/707] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Jun 22 08:42:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:42:56.564405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:56.574587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:56.575918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.576356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.576833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.592122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:56.594174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:56.618012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:56.619176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:56.620283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:56.620283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:56.620283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:56.620283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:56.622683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 352/708] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:56.631061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:56.686695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:56.708534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d3f0d-e9ef-440e-8aca-f280be72df34 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:56.740001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:56.774186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:56.775205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.775661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.776102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.776982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:56.777488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:56.779930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:56.785368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 357/709] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 22 08:42:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:56.793321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:56.859010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f94a2d-2e4d-4f13-8075-dfd4fe036dbe None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:56.910212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e0fc1-67b6-49e3-8ddc-9f729bac989a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:56.932471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622b600-50c1-4622-a758-0bf54e6a06c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:56.933148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b600-50c1-4622-a758-0bf54e6a06c6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.933431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b600-50c1-4622-a758-0bf54e6a06c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.933709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b600-50c1-4622-a758-0bf54e6a06c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.934605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622b600-50c1-4622-a758-0bf54e6a06c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:56.934916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622b600-50c1-4622-a758-0bf54e6a06c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:56.936286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622b600-50c1-4622-a758-0bf54e6a06c6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:56.949690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 353/710] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:56.951538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a62f-8a2d-40c0-9b8f-4b44ab477c6c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.951832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a62f-8a2d-40c0-9b8f-4b44ab477c6c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.952108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a62f-8a2d-40c0-9b8f-4b44ab477c6c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.957503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 354/711] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:56.958333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819a62f-8a2d-40c0-9b8f-4b44ab477c6c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:56.958656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b88bd4-a8a9-436e-90a6-d289517ee2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:56.959502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b88bd4-a8a9-436e-90a6-d289517ee2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.959936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b88bd4-a8a9-436e-90a6-d289517ee2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.960407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b88bd4-a8a9-436e-90a6-d289517ee2f1 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:56.961325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b88bd4-a8a9-436e-90a6-d289517ee2f1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:56.961980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b88bd4-a8a9-436e-90a6-d289517ee2f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:56.965092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b88bd4-a8a9-436e-90a6-d289517ee2f1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:56.974289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 358/712] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 22 08:42:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:56.976362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca76d-d4f4-47c8-99aa-dc707f3011cb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:56.976837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca76d-d4f4-47c8-99aa-dc707f3011cb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:56.977329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca76d-d4f4-47c8-99aa-dc707f3011cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.000183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a1dca76d-d4f4-47c8-99aa-dc707f3011cb None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:57.002198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a1dca76d-d4f4-47c8-99aa-dc707f3011cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:57.024346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:57.101812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 359/713] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:57.141106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dca76d-d4f4-47c8-99aa-dc707f3011cb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:57.178550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819a62f-8a2d-40c0-9b8f-4b44ab477c6c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:57.210474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:57.248114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:57.249121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.249763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.249763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.259408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:57.260881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:57.276890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dca76d-d4f4-47c8-99aa-dc707f3011cb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:42:57.277591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:57.279450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:57.280576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:42:57.280576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:42:57.280576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:42:57.280576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:42:57.280576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:42:57.280576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:42:57.280576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:42:57.280576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:57.282217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 355/714] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:57.287784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:57.331341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:57.334046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.334362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.334644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.335314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:57.336711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:57.353501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:57.354836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:42:57.355765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:57.359430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 360/715] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:42:57 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:57.365736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:57.381692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:57.424466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42942c8b-c3ce-4cd0-9daf-71b577641848 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:57.469231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:57.470748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.471446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.472016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.473053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:57.473617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:57.475769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:57.492718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 356/716] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:57.499815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:57.522492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c22191-2ac8-4004-aa5a-ffd2aa4a91e0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:57.568612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:57.591215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:57.592262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.592752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.593197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.594141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] RBAC: Adding query filter params (name=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:57.594614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:57.597235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:57.608542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 361/717] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:42:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:57.614153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:57.697720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5797-2bf0-4558-a39f-ebff5691f1b5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:57.752081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:57.780350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a9adf-137f-44c0-9d6b-002c561737eb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:57.787408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c601fd2-0d91-469d-b4e6-baceb2f42b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:57.788080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601fd2-0d91-469d-b4e6-baceb2f42b7d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.788360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601fd2-0d91-469d-b4e6-baceb2f42b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.788634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601fd2-0d91-469d-b4e6-baceb2f42b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.789527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c601fd2-0d91-469d-b4e6-baceb2f42b7d None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=4ade274e49f748ee8e3bec2a963cf1b2) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:57.789775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c601fd2-0d91-469d-b4e6-baceb2f42b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:57.791262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c601fd2-0d91-469d-b4e6-baceb2f42b7d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:57.798210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 357/718] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:42:57 2022] GET /identity/v3/role_assignments?user.id=4ade274e49f748ee8e3bec2a963cf1b2&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:57.860440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cf4ed-d738-48f2-8dde-33e66937cf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:57.861379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf4ed-d738-48f2-8dde-33e66937cf41 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:57.861808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf4ed-d738-48f2-8dde-33e66937cf41 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:57.862281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf4ed-d738-48f2-8dde-33e66937cf41 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:57.863149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf4ed-d738-48f2-8dde-33e66937cf41 None admin] RBAC: Adding query filter params (type=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:57.863616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf4ed-d738-48f2-8dde-33e66937cf41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:57.865189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf4ed-d738-48f2-8dde-33e66937cf41 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:57.875134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 362/719] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:42:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:42:58.568934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f9816-00e3-4c10-92ad-6a1c25ed507b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:58.569996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f9816-00e3-4c10-92ad-6a1c25ed507b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:58.570528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f9816-00e3-4c10-92ad-6a1c25ed507b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:58.572557 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 358/720] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:58.578459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726a8a-7cbd-4cb4-812a-ef679028205e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:58.579422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726a8a-7cbd-4cb4-812a-ef679028205e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:58.579916 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726a8a-7cbd-4cb4-812a-ef679028205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:58.603260 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-82726a8a-7cbd-4cb4-812a-ef679028205e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:58.604865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-82726a8a-7cbd-4cb4-812a-ef679028205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:58.699437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 363/721] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 08:42:58.737364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f9816-00e3-4c10-92ad-6a1c25ed507b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:58.783220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae260859-b973-447a-b535-edff4445b061 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:58.783857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae260859-b973-447a-b535-edff4445b061 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:58.784337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae260859-b973-447a-b535-edff4445b061 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:58.786133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 364/722] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:58.807764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d26ba-ee70-4525-9790-73095b8e1504 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:58.807973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d26ba-ee70-4525-9790-73095b8e1504 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:58.808218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d26ba-ee70-4525-9790-73095b8e1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:58.838233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a84d26ba-ee70-4525-9790-73095b8e1504 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:58.839633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a84d26ba-ee70-4525-9790-73095b8e1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:58.870241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:58.877716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f9816-00e3-4c10-92ad-6a1c25ed507b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:58.947016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:58.951446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc8da2-6899-4531-85d8-fd664a5261f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:58.952243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc8da2-6899-4531-85d8-fd664a5261f5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:58.952529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc8da2-6899-4531-85d8-fd664a5261f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:58.952808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc8da2-6899-4531-85d8-fd664a5261f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:58.954995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 365/723] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:58.976828 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc8da2-6899-4531-85d8-fd664a5261f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d5fc8da2-6899-4531-85d8-fd664a5261f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:58.986207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:58.987139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:42:58.987958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:58.994506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 359/724] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:59.002385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d26ba-ee70-4525-9790-73095b8e1504 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.007386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc8da2-6899-4531-85d8-fd664a5261f5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.146095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc8da2-6899-4531-85d8-fd664a5261f5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:59.148751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d26ba-ee70-4525-9790-73095b8e1504 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:59.208660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbae79-29d2-484b-b33d-af3f116d3fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:59.209844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbae79-29d2-484b-b33d-af3f116d3fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.210356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbae79-29d2-484b-b33d-af3f116d3fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.210932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbae79-29d2-484b-b33d-af3f116d3fc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.214780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:59.215537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.216344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.216825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.217884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:59.218233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:59.219634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:59.225024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddbae79-29d2-484b-b33d-af3f116d3fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-4ddbae79-29d2-484b-b33d-af3f116d3fc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:42:59.234973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:59.235990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:42:59.236820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:59.239664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 360/725] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:59.244349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 366/726] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:59.245442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbae79-29d2-484b-b33d-af3f116d3fc4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.250191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.286394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:59.362443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:59.444325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9523c-7a14-4c66-8d8a-ff4e7c6be952 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:59.459904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbae79-29d2-484b-b33d-af3f116d3fc4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:59.516051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:59.516850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.517136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.517413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.530109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:59.530859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.531146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.531430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.532187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:59.532499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:59.533854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:59.539477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:59.540918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:59.554218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 361/727] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:59.558967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:59.560360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:59.561273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:59.561273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:59.561273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:59.561273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:42:59.561895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 367/728] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:59.562887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.566730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.697913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:59.717510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb5472-4a2e-4d13-a150-43a79bf63594 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:59.751661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c553a-4586-43ad-8f5e-4d78b5451c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:59.752462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c553a-4586-43ad-8f5e-4d78b5451c76 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.752749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c553a-4586-43ad-8f5e-4d78b5451c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.753027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c553a-4586-43ad-8f5e-4d78b5451c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.771032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74dd8b-464a-492e-b045-b50f90244689 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:59.781908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c553a-4586-43ad-8f5e-4d78b5451c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:59.783389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c553a-4586-43ad-8f5e-4d78b5451c76 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:59.799114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-578c553a-4586-43ad-8f5e-4d78b5451c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:42:59.808014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:42:59.808969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:42:59.809952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:42:59.809952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:42:59.809952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:42:59.809952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:42:59.812048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 362/729] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:42:59.813550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9fe97-aa86-4168-af36-eff3f91a9505 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.819594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9fe97-aa86-4168-af36-eff3f91a9505 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.819594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9fe97-aa86-4168-af36-eff3f91a9505 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.819594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 363/730] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:42:59.819594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9fe97-aa86-4168-af36-eff3f91a9505 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.837847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f4479-2ec8-4f79-a005-35f479be31da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:59.837847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4479-2ec8-4f79-a005-35f479be31da None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.837847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4479-2ec8-4f79-a005-35f479be31da None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.837847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f4479-2ec8-4f79-a005-35f479be31da None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.838288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f4479-2ec8-4f79-a005-35f479be31da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:59.838288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f4479-2ec8-4f79-a005-35f479be31da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:59.838288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f4479-2ec8-4f79-a005-35f479be31da None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:42:59.854349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 368/731] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:42:59.858238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5059b-ca37-410e-857e-42068c2c319e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.858238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5059b-ca37-410e-857e-42068c2c319e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.858238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5059b-ca37-410e-857e-42068c2c319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.879599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-94f5059b-ca37-410e-857e-42068c2c319e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:42:59.880809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-94f5059b-ca37-410e-857e-42068c2c319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:42:59.943251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9fe97-aa86-4168-af36-eff3f91a9505 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:42:59.968566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 369/732] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:42:59.969862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5059b-ca37-410e-857e-42068c2c319e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:42:59.982635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:42:59.993390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:42:59.994495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:42:59.994694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:42:59.994976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:42:59.995711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:42:59.996026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:42:59.997898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:00.018097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 364/733] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:00.018097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:00.104605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5059b-ca37-410e-857e-42068c2c319e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:00.107445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:00.148873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb64a-78bf-46a1-97a5-56bef855375d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:00.149537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:00.150411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.150698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.150977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.160848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:00.162784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:00.182827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:00.183807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:43:00.184754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:00.189423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 370/734] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:42:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:00.190645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:00.194985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d20e6-a3dc-49bf-a096-b6630f995ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:00.195902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d20e6-a3dc-49bf-a096-b6630f995ca6 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.196408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d20e6-a3dc-49bf-a096-b6630f995ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.196887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d20e6-a3dc-49bf-a096-b6630f995ca6 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.197805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d20e6-a3dc-49bf-a096-b6630f995ca6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:00.199629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d20e6-a3dc-49bf-a096-b6630f995ca6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:00.297335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c19a8-f7e3-4e24-aa62-866b67625f1b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:00.298337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 365/735] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:43:00 2022] POST /identity/v3/services => generated 251 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:00.299376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d20e6-a3dc-49bf-a096-b6630f995ca6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:00.350934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae8675-37a1-4421-ac1b-0a42279614d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:00.352213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae8675-37a1-4421-ac1b-0a42279614d4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.352675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae8675-37a1-4421-ac1b-0a42279614d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.353158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae8675-37a1-4421-ac1b-0a42279614d4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.364099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae8675-37a1-4421-ac1b-0a42279614d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:00.365833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae8675-37a1-4421-ac1b-0a42279614d4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:00.376786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-21ae8675-37a1-4421-ac1b-0a42279614d4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:00.382863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:00.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:00.384812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:00.389182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 371/736] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:43:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:00.390723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fce94-e60a-4e80-ac2a-6992214595a1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.391014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fce94-e60a-4e80-ac2a-6992214595a1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.391292 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fce94-e60a-4e80-ac2a-6992214595a1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.401068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 372/737] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:00.401068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fce94-e60a-4e80-ac2a-6992214595a1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:00.416788 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:00.444811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d20e6-a3dc-49bf-a096-b6630f995ca6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:00.495749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b5b00-79df-4021-8d19-5c0dba7b0936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:00.496472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5b00-79df-4021-8d19-5c0dba7b0936 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.497527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5b00-79df-4021-8d19-5c0dba7b0936 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.498033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b5b00-79df-4021-8d19-5c0dba7b0936 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.498948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b5b00-79df-4021-8d19-5c0dba7b0936 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:00.499270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b5b00-79df-4021-8d19-5c0dba7b0936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:00.500788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b5b00-79df-4021-8d19-5c0dba7b0936 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:00.518958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fce94-e60a-4e80-ac2a-6992214595a1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:00.521387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 366/738] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 22 08:43:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:00.522929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c581e8-6a70-4dac-9bb3-3306f13ac0ed None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.523424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c581e8-6a70-4dac-9bb3-3306f13ac0ed None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.523875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c581e8-6a70-4dac-9bb3-3306f13ac0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.542123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d1c581e8-6a70-4dac-9bb3-3306f13ac0ed None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:00.544389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d1c581e8-6a70-4dac-9bb3-3306f13ac0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:00.557557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446927a-78d4-4188-a265-102af145bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:00.558194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446927a-78d4-4188-a265-102af145bc1c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.558499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446927a-78d4-4188-a265-102af145bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.564402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446927a-78d4-4188-a265-102af145bc1c None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.564402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446927a-78d4-4188-a265-102af145bc1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:00.564402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446927a-78d4-4188-a265-102af145bc1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:00.564402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446927a-78d4-4188-a265-102af145bc1c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:00.579490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 373/739] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 22 08:43:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:00.581110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa314-11e0-4a93-abba-1910f755131d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.581401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa314-11e0-4a93-abba-1910f755131d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.581678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058aa314-11e0-4a93-abba-1910f755131d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.583010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 374/740] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:00.583625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aa314-11e0-4a93-abba-1910f755131d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:00.631816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 367/741] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:43:00.633125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940322a-c36a-495d-ba9b-1ccd14424846 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.633419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940322a-c36a-495d-ba9b-1ccd14424846 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.633700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940322a-c36a-495d-ba9b-1ccd14424846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.650916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1940322a-c36a-495d-ba9b-1ccd14424846 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:00.652171 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1940322a-c36a-495d-ba9b-1ccd14424846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:00.673678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:00.692717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:00.697918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058aa314-11e0-4a93-abba-1910f755131d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:00.729154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 368/742] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 08:43:00.730045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940322a-c36a-495d-ba9b-1ccd14424846 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:00.745557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c8df5-c886-4d60-a3a4-2af13cf15db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:00.747436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8df5-c886-4d60-a3a4-2af13cf15db3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.747795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8df5-c886-4d60-a3a4-2af13cf15db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.748172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c8df5-c886-4d60-a3a4-2af13cf15db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.822403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c8df5-c886-4d60-a3a4-2af13cf15db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:00.822403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c8df5-c886-4d60-a3a4-2af13cf15db3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:00.853840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940322a-c36a-495d-ba9b-1ccd14424846 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:00.890894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82806f6e-41d5-414a-a42f-0ff6259c27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:00.891539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82806f6e-41d5-414a-a42f-0ff6259c27b7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:00.891824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82806f6e-41d5-414a-a42f-0ff6259c27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:00.892101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82806f6e-41d5-414a-a42f-0ff6259c27b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:00.915958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:00.935637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:00.944781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 375/743] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:43:00.944781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c8df5-c886-4d60-a3a4-2af13cf15db3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:00.973833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82806f6e-41d5-414a-a42f-0ff6259c27b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:00.975316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82806f6e-41d5-414a-a42f-0ff6259c27b7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.044325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c8df5-c886-4d60-a3a4-2af13cf15db3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.082603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce8b36-8f6c-42ad-9574-d37d224334f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.083315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce8b36-8f6c-42ad-9574-d37d224334f4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.083598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce8b36-8f6c-42ad-9574-d37d224334f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.083873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce8b36-8f6c-42ad-9574-d37d224334f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.086821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 369/744] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:00 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 08:43:01.092138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82806f6e-41d5-414a-a42f-0ff6259c27b7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.102955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce8b36-8f6c-42ad-9574-d37d224334f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ccce8b36-8f6c-42ad-9574-d37d224334f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:01.111858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:01.112807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 376/745] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:01.119098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce8b36-8f6c-42ad-9574-d37d224334f4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.174738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:01.207159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82806f6e-41d5-414a-a42f-0ff6259c27b7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.244043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980212-c985-4946-b46a-543c4b81dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.244704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980212-c985-4946-b46a-543c4b81dca3 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.244984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980212-c985-4946-b46a-543c4b81dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.245258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980212-c985-4946-b46a-543c4b81dca3 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.245971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8980212-c985-4946-b46a-543c4b81dca3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:01.247649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8980212-c985-4946-b46a-543c4b81dca3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.265884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:01.328343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce8b36-8f6c-42ad-9574-d37d224334f4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.348666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 370/746] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:43:01 2022] POST /identity/v3/services => generated 240 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:01.349703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980212-c985-4946-b46a-543c4b81dca3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.381110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.382159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.382565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.382895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.397191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:01.398755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:01.424261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:01.425247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:01.426152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:01.426152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:01.426152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:01.426152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:01.427982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 377/747] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:01.428961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.491110 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980212-c985-4946-b46a-543c4b81dca3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.525863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:01.534080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.534897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.535186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.540276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.540379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:01.547533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:01.549000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.554933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e5efc-e662-40c9-8760-745ca3d1f8c5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:01.569972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:01.570931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:01.571843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:01.571843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:01.571843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:01.571843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:01.571843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 371/748] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:01.572111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.608056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.609708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.610238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.611412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.612638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:01.613175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:01.615917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.627214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 378/749] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:01.628638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.706910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cd93d-d102-4484-8a8c-44e290e7cef1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.751590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.752347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.752564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.753069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.753833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:01.754583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:01.756290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.764591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95679-7771-4397-a72d-be198903e438 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.773085 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 372/750] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:01.773933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.813085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.814814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.815298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.815766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.816937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:01.821455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:01.822258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.831107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:01.845445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 379/751] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:01.846861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:01.866279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:01.912617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a85395-8702-4c56-ad48-f73ffd78d79c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:01.966936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:01.968399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:01.969354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:01.969866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:01.985792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:01.987568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:01.989226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577b63-61d3-4527-a7ab-41634d9f16e8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:02.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:02.007607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:02.008477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:02.008477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:02.008477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:02.008477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:02.010737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 373/752] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:02.011833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.024953 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.025933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.026043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.026308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.034271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.035477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:02.049706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:02.050629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:02.051527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 380/753] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:02.052003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.117413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:02.121745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:02.125753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c3d6d-df91-4cf4-b426-31fd6ff495d9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.164493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.165396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876d05d-687e-4a7c-860c-bb8b31822e68 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.165915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.166456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.166975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.175675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.177468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:02.194202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:02.195107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:02.196011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:02.196011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:02.196011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:02.196011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:02.196011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:02.196011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:02.196011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:02.196011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:02.198712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 374/754] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:02.199738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.210529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.213341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.213850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.216955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.217943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:02.218468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.220196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.234911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 381/755] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:02.236204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.328482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260198d-0efb-4454-a5d4-bccfe4e15ab9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.347993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5d6c4-915b-49de-8cfb-f9534df3dfa1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.362345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.362997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.363380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.363553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.364330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:02.364635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.366115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.378417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:02.380374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 375/756] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:02.380986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.389977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.391740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.391740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.392158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.393310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:02.393815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.395657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.398136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:02.411175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 382/757] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:02.412349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.489847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac66d0-ff38-4105-9c0a-eb7b2bcd344c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.524109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425e84b-bd4e-41ce-bd9c-4b474fba55ec None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.530200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.530993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.531272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.531541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.539368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.540796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:02.556848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:02.558175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:02.559510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:02.563398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 376/758] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:02.563398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.564654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603e3ab-b138-430e-8f76-7e8e651fb7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.565366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e3ab-b138-430e-8f76-7e8e651fb7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.565653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e3ab-b138-430e-8f76-7e8e651fb7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.565925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e3ab-b138-430e-8f76-7e8e651fb7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.566810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603e3ab-b138-430e-8f76-7e8e651fb7a0 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=05a163118f6f44fdbad0c7c889970a7c) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:02.567125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603e3ab-b138-430e-8f76-7e8e651fb7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.568591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603e3ab-b138-430e-8f76-7e8e651fb7a0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.581355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 383/759] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/role_assignments?user.id=05a163118f6f44fdbad0c7c889970a7c&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:02.583001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059d5a-5a0e-4e86-9f14-47d19f3e0ac9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.583269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059d5a-5a0e-4e86-9f14-47d19f3e0ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.583552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc059d5a-5a0e-4e86-9f14-47d19f3e0ac9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.589437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 384/760] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:02.589437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc059d5a-5a0e-4e86-9f14-47d19f3e0ac9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.655703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:02.687075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:02.718382 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc059d5a-5a0e-4e86-9f14-47d19f3e0ac9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.720061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0c33b-28c6-42b7-a98a-b76253df93a4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.757770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.758005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74023a-1332-4afa-a61c-f4fb76cab66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.758626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74023a-1332-4afa-a61c-f4fb76cab66a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.758909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74023a-1332-4afa-a61c-f4fb76cab66a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.759186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74023a-1332-4afa-a61c-f4fb76cab66a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.759654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.760018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74023a-1332-4afa-a61c-f4fb76cab66a None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=6a6d40d5beb849a0aa34a56efbe4b525) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:02.760233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.760352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74023a-1332-4afa-a61c-f4fb76cab66a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.760752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.761733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:02.761857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74023a-1332-4afa-a61c-f4fb76cab66a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.762355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.764887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.769256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 377/761] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/role_assignments?user.id=6a6d40d5beb849a0aa34a56efbe4b525&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:02.769970 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf2bf-0954-4008-aa39-2ac638cf6f2d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.770289 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf2bf-0954-4008-aa39-2ac638cf6f2d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.770565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaf2bf-0954-4008-aa39-2ac638cf6f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.788328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3cfaf2bf-0954-4008-aa39-2ac638cf6f2d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:02.789796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3cfaf2bf-0954-4008-aa39-2ac638cf6f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:02.789978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 385/762] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:02.795698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.884781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 378/763] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:02.911011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaf2bf-0954-4008-aa39-2ac638cf6f2d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:02.930466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d4c4b-09e2-44d4-b642-9e9cb9a4aa94 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:02.941286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:02.970104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:02.970908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:02.981445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:02.981445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:02.985869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:02.987739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:02.989734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:03.022097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:03.023097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:03.024013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:03.024013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:03.024013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:03.024013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:03.024013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 386/764] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:03.026925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:03.054249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaf2bf-0954-4008-aa39-2ac638cf6f2d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:03.095611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:03.096963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.097529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.097821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.098781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:03.100710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:03.120556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:03.121610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:03.122937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 379/765] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Jun 22 08:43:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:03.130484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:03.165949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abc75d-bf4b-48ab-932a-abab397b9adc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:03.203313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:03.203978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.204261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.204535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.205368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:03.205706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:03.207103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:03.220188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 387/766] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:03.225435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:03.273826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:03.314870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20644210-101b-4486-8614-ddfc4a4b4868 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:03.346467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:03.351293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:03.351765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.352053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.352330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.353042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:03.353349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:03.354743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:03.361176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 380/767] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 22 08:43:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:03.369236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:03.390806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9c761-b245-489a-bc2d-f31cbb79dab6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:03.428872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:03.429592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.429875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.430178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.437225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:03.438696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:03.453240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:03.454202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:03.455100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 388/768] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:03.459929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:03.573368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284abba9-6251-4e73-837e-e81824d424b9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:03.617998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:03.638849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedde0d-2c0c-49e9-af79-5b8b559a6bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:03.640402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedde0d-2c0c-49e9-af79-5b8b559a6bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.640876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedde0d-2c0c-49e9-af79-5b8b559a6bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.641345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedde0d-2c0c-49e9-af79-5b8b559a6bc6 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.642247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b6361-d539-4f54-b285-934e4e94384c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:03.642466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedde0d-2c0c-49e9-af79-5b8b559a6bc6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:03.643015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedde0d-2c0c-49e9-af79-5b8b559a6bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:03.645549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedde0d-2c0c-49e9-af79-5b8b559a6bc6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:03.653301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 381/769] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 22 08:43:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:03.654995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0216b-e046-4b01-83f3-ff7970061192 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.655458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0216b-e046-4b01-83f3-ff7970061192 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.655928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0216b-e046-4b01-83f3-ff7970061192 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.661741 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 382/770] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:03.663034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0216b-e046-4b01-83f3-ff7970061192 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:03.687278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ac80b-92bb-426b-9978-49222ff8c9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:03.687854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ac80b-92bb-426b-9978-49222ff8c9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.688322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ac80b-92bb-426b-9978-49222ff8c9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.688710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ac80b-92bb-426b-9978-49222ff8c9a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.689645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ac80b-92bb-426b-9978-49222ff8c9a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:03.689964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ac80b-92bb-426b-9978-49222ff8c9a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:03.691555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ac80b-92bb-426b-9978-49222ff8c9a1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:03.704115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 389/771] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:03.705581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca84d9-189c-4a62-bea7-6c8f217cccad None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.705943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca84d9-189c-4a62-bea7-6c8f217cccad None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.706311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca84d9-189c-4a62-bea7-6c8f217cccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.723906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6fca84d9-189c-4a62-bea7-6c8f217cccad None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:03.725179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6fca84d9-189c-4a62-bea7-6c8f217cccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:03.745281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:03.794709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0216b-e046-4b01-83f3-ff7970061192 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:03.805890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 390/772] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:03.805890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca84d9-189c-4a62-bea7-6c8f217cccad None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:03.849870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:03.850895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.851365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.851841 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.852814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] RBAC: Adding query filter params (interface=public, service_id=1181a1e2ae5e4faab684e06589e1c716, region_id=RegionOne) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:03.853323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:03.854931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:03.865393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 383/773] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 22 08:43:03 2022] GET /identity/v3/endpoints?service_id=1181a1e2ae5e4faab684e06589e1c716&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:03.866607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:03.886445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:03.919778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca84d9-189c-4a62-bea7-6c8f217cccad None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:03.956306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee8b4-a401-4a4b-8717-7f1194561781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:03.957245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee8b4-a401-4a4b-8717-7f1194561781 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:03.957593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee8b4-a401-4a4b-8717-7f1194561781 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:03.958097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee8b4-a401-4a4b-8717-7f1194561781 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/4ade274e49f748ee8e3bec2a963cf1b2/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:03.960131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ee8b4-a401-4a4b-8717-7f1194561781 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=4ade274e49f748ee8e3bec2a963cf1b2, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:03.962095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ee8b4-a401-4a4b-8717-7f1194561781 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:03.981483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c68f9-68b1-4a2a-9d1a-5a928b8b4ca2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:04.006652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:04.018303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:04.019100 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:04.019388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:04.019671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:04.020324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:04.021709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:04.034121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:04.035315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:43:04.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:04.039299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 384/774] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:03 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:04.040212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:04.046732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 391/775] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:43:03 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/4ade274e49f748ee8e3bec2a963cf1b2/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:43:04.047772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee8b4-a401-4a4b-8717-7f1194561781 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:04.182102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a1292-58fe-4623-ae8b-14a93f8480f1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:04.190996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee8b4-a401-4a4b-8717-7f1194561781 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:04.227350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:04.235094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:04.236381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:04.236829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:04.237535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:04.238992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] RBAC: Adding query filter params (name=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:04.239493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:04.241210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:04.248080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 392/776] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:04.253644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:04.265196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b8979-cfae-4d17-9fd7-421d9fd5618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:04.265883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8979-cfae-4d17-9fd7-421d9fd5618e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:04.266217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8979-cfae-4d17-9fd7-421d9fd5618e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:04.266500 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8979-cfae-4d17-9fd7-421d9fd5618e None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:04.267733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b8979-cfae-4d17-9fd7-421d9fd5618e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:04.269455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b8979-cfae-4d17-9fd7-421d9fd5618e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:04.278706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 385/777] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:43:04 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:04.385707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ee81-f796-47e4-a862-111953f4849b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:04.440181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:04.441116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:04.441550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:04.442006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:04.442928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:04.443442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:04.445023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:04.452081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 393/778] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:04.457666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b8979-cfae-4d17-9fd7-421d9fd5618e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:04.538134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:04.589487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b8979-cfae-4d17-9fd7-421d9fd5618e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:04.627458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e099e-354b-4d66-bd92-f482465d27a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:04.628129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e099e-354b-4d66-bd92-f482465d27a4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:04.628415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e099e-354b-4d66-bd92-f482465d27a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:04.628695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e099e-354b-4d66-bd92-f482465d27a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:04.629493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e099e-354b-4d66-bd92-f482465d27a4 None admin] RBAC: Adding query filter params (interface=public, service_id=36505fd96c4b4624b75773da64430938, region_id=RegionOne) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:04.629807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e099e-354b-4d66-bd92-f482465d27a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:04.631206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e099e-354b-4d66-bd92-f482465d27a4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:04.643431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 386/779] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 22 08:43:04 2022] GET /identity/v3/endpoints?service_id=36505fd96c4b4624b75773da64430938&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:04.644870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:04.707223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:04.750789 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d93eea-f228-4584-80ce-630b1530cec9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:04.786541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f5dda-6d01-4968-ab10-c807ac9def42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:04.787213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5dda-6d01-4968-ab10-c807ac9def42 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:04.787497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5dda-6d01-4968-ab10-c807ac9def42 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:04.787777 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f5dda-6d01-4968-ab10-c807ac9def42 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:04.788522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f5dda-6d01-4968-ab10-c807ac9def42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:04.789830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f5dda-6d01-4968-ab10-c807ac9def42 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:04.802234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 394/780] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:43:04 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:05.023866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446363b8-8697-4929-83e7-aef1105a8ba5 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:05.024767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446363b8-8697-4929-83e7-aef1105a8ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:05.025230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446363b8-8697-4929-83e7-aef1105a8ba5 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:05.026833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 387/781] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:05.032397 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daa2ff-1c8e-44e1-8a1c-efdd9bc8f2cf None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:05.032822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daa2ff-1c8e-44e1-8a1c-efdd9bc8f2cf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:05.033007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daa2ff-1c8e-44e1-8a1c-efdd9bc8f2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:05.054636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d1daa2ff-1c8e-44e1-8a1c-efdd9bc8f2cf None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:05.056178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d1daa2ff-1c8e-44e1-8a1c-efdd9bc8f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:05.140321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 395/782] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:05.175296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446363b8-8697-4929-83e7-aef1105a8ba5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:05.325601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446363b8-8697-4929-83e7-aef1105a8ba5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:05.345803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:05.364373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa524-15e4-4168-bf25-5a57e4c0a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:05.365173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa524-15e4-4168-bf25-5a57e4c0a814 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:05.368554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa524-15e4-4168-bf25-5a57e4c0a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:05.368554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa524-15e4-4168-bf25-5a57e4c0a814 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:05.379021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa524-15e4-4168-bf25-5a57e4c0a814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-358fa524-15e4-4168-bf25-5a57e4c0a814 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:05.388560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:05.389514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:05.390382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 388/783] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:05.397474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daa2ff-1c8e-44e1-8a1c-efdd9bc8f2cf None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:05.479731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:05.538207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daa2ff-1c8e-44e1-8a1c-efdd9bc8f2cf None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:05.565014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bf73-eaea-4e56-a2bd-395521e8116f None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:05.565306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bf73-eaea-4e56-a2bd-395521e8116f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:05.565588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bf73-eaea-4e56-a2bd-395521e8116f None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:05.567249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 389/784] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:05.582362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abc54-85a7-426c-a779-3130f60bd279 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:05.582942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abc54-85a7-426c-a779-3130f60bd279 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:05.583423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abc54-85a7-426c-a779-3130f60bd279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:05.588185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:05.592370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:05.592370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:05.592370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:05.592370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:05.592370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:05.592370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:05.602503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 396/785] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:05.609155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:05.626087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b00abc54-85a7-426c-a779-3130f60bd279 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:05.626087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b00abc54-85a7-426c-a779-3130f60bd279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:05.775766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 390/786] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:05.778955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a05c1-e393-4fc5-b0a5-b86727cf0a1f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:05.794658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:05.816306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00abc54-85a7-426c-a779-3130f60bd279 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:05.826950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:05.826950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:05.826950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:05.827239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:05.859174 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:05.860641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:05.889936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:05.890860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:05.891736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:05.891736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:05.891736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:05.891736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:05.899561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 397/787] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:05.905617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:05.938969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00abc54-85a7-426c-a779-3130f60bd279 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:05.946470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:05.976905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a812c5-6928-40a5-b25a-649275cae9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:05.978787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a812c5-6928-40a5-b25a-649275cae9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:05.979072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a812c5-6928-40a5-b25a-649275cae9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:05.979351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a812c5-6928-40a5-b25a-649275cae9b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.001404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a812c5-6928-40a5-b25a-649275cae9b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-99a812c5-6928-40a5-b25a-649275cae9b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:06.010491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:06.011413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:06.013031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 391/788] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:43:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:06.023234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a812c5-6928-40a5-b25a-649275cae9b6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:06.062579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6e477-dad5-456f-b90a-be10aa99776e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:06.138685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:06.139284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.139574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.139852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.140593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:06.140904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:06.142299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:06.152140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a812c5-6928-40a5-b25a-649275cae9b6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:06.170399 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 398/789] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:06.171332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:06.198799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:06.199598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.200373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.200708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.201590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:06.201960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:06.203596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:06.205050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:06.217062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 392/790] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:06.222636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:06.254915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:06.335782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07a78f-1bf4-4b74-9ac9-e129765e9e0e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:06.358824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a391-2ba2-457c-831a-e58286fa69c9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:06.401281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:06.401997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.402313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.403112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.412509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:06.414389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:06.424902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:06.425739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.426037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.426334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:06.445438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:06.446445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:43:06.447378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:06.447916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:06.451591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:06.451723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 399/791] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:06.456224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:06.478037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:06.478999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:06.479881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:06.479881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:06.479881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:06.479881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:06.482973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 393/792] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:06.491429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:06.585805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:06.603375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde39026-a07c-48b6-94d8-ae31e8280fa0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:06.645854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb3ba0-ac47-45b4-af66-c28407bfabf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:06.646554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb3ba0-ac47-45b4-af66-c28407bfabf3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.646840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb3ba0-ac47-45b4-af66-c28407bfabf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.647116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb3ba0-ac47-45b4-af66-c28407bfabf3 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.648265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb3ba0-ac47-45b4-af66-c28407bfabf3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:06.648576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb3ba0-ac47-45b4-af66-c28407bfabf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:06.650077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb3ba0-ac47-45b4-af66-c28407bfabf3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:06.673584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:06.682969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 400/793] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 22 08:43:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:06.685220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a4a1-6ac2-4a71-bf0f-da6de84aae8f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.685531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a4a1-6ac2-4a71-bf0f-da6de84aae8f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.685808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a4a1-6ac2-4a71-bf0f-da6de84aae8f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.688275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 401/794] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:06.689026 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a4a1-6ac2-4a71-bf0f-da6de84aae8f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:06.701217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932b6df-ebd6-44b9-91de-f2f7f5edfed7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:06.743899 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aff707-4f50-4094-b70a-2f277c34a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:06.744627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff707-4f50-4094-b70a-2f277c34a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.744906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff707-4f50-4094-b70a-2f277c34a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.745179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff707-4f50-4094-b70a-2f277c34a3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.746388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aff707-4f50-4094-b70a-2f277c34a3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:06.747204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aff707-4f50-4094-b70a-2f277c34a3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:06.749462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aff707-4f50-4094-b70a-2f277c34a3c2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:06.767028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 394/795] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:06.768349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b74af-a21f-4e89-8447-7334680afdd8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.768635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b74af-a21f-4e89-8447-7334680afdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.768911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b74af-a21f-4e89-8447-7334680afdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.789124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b74b74af-a21f-4e89-8447-7334680afdd8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:06.790424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b74b74af-a21f-4e89-8447-7334680afdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:06.827463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a4a1-6ac2-4a71-bf0f-da6de84aae8f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:06.870737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:06.872351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:06.872803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:06.873216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:06.882076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 395/796] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:06.882076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b74af-a21f-4e89-8447-7334680afdd8 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:06.891307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:06.898085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:06.902865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:06.928014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:06.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:06.930256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:06.930256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:06.930256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:06.930256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:06.930256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 402/797] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:06.933731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:06.957017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:06.992240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b74af-a21f-4e89-8447-7334680afdd8 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.030555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.031710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.032191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.032646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.041636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.042991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c46d4-5b2c-43db-9ce1-1f755348e5f8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.043850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:07.060914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:07.061917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:07.062882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:07.065313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 396/798] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:43:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:07.070746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.079906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ada90-7193-48c3-b8d1-96615b3f0794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.080698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ada90-7193-48c3-b8d1-96615b3f0794 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.080979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ada90-7193-48c3-b8d1-96615b3f0794 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.081251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ada90-7193-48c3-b8d1-96615b3f0794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.093055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ada90-7193-48c3-b8d1-96615b3f0794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-779ada90-7193-48c3-b8d1-96615b3f0794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:07.100955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:07.101968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:07.102845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 403/799] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:07.103526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ada90-7193-48c3-b8d1-96615b3f0794 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.161234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:07.189461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369a802-4c9a-49ee-a8c8-7f9cd8a6f707 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.208159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ada90-7193-48c3-b8d1-96615b3f0794 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.218306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:07.224162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22b0a9-c30c-4032-8c4b-f1e595851444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.224824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b0a9-c30c-4032-8c4b-f1e595851444 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.225109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b0a9-c30c-4032-8c4b-f1e595851444 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.225447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b0a9-c30c-4032-8c4b-f1e595851444 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.226217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22b0a9-c30c-4032-8c4b-f1e595851444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:07.226529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22b0a9-c30c-4032-8c4b-f1e595851444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.227886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22b0a9-c30c-4032-8c4b-f1e595851444 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.239572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 397/800] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:07.240813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2251-49f6-4d8e-9de0-01be4398cbec None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.241099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2251-49f6-4d8e-9de0-01be4398cbec None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.241379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2251-49f6-4d8e-9de0-01be4398cbec None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.242628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 398/801] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:07.243321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2251-49f6-4d8e-9de0-01be4398cbec None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.246118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f93d1c-5302-4d01-8616-3e77cddb9277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.246814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93d1c-5302-4d01-8616-3e77cddb9277 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.247099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93d1c-5302-4d01-8616-3e77cddb9277 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.247376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93d1c-5302-4d01-8616-3e77cddb9277 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.248214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f93d1c-5302-4d01-8616-3e77cddb9277 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:07.248528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f93d1c-5302-4d01-8616-3e77cddb9277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.249973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f93d1c-5302-4d01-8616-3e77cddb9277 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.267931 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 404/802] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:07.269189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0981e-e343-4363-bba0-f341c3f8caa9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.269480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0981e-e343-4363-bba0-f341c3f8caa9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.269759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0981e-e343-4363-bba0-f341c3f8caa9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.274781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 405/803] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:07.274781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0981e-e343-4363-bba0-f341c3f8caa9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.353354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2251-49f6-4d8e-9de0-01be4398cbec None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.374301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0981e-e343-4363-bba0-f341c3f8caa9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.387761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198514c6-9f57-43bf-8ee1-b9d3cac481d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.388520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198514c6-9f57-43bf-8ee1-b9d3cac481d1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.388673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:07.388794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198514c6-9f57-43bf-8ee1-b9d3cac481d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.389077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198514c6-9f57-43bf-8ee1-b9d3cac481d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.389820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198514c6-9f57-43bf-8ee1-b9d3cac481d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:07.390255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198514c6-9f57-43bf-8ee1-b9d3cac481d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.391526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198514c6-9f57-43bf-8ee1-b9d3cac481d1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.399945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 399/804] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:07.401077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69f76-f51e-4752-a4df-122eef2a3a8d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.401374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69f76-f51e-4752-a4df-122eef2a3a8d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.401657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69f76-f51e-4752-a4df-122eef2a3a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.408934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.409724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.410005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.410310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.416965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.418602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7ef69f76-f51e-4752-a4df-122eef2a3a8d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:07.418719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.419944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7ef69f76-f51e-4752-a4df-122eef2a3a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:07.432038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:07.432919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 406/805] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:07.438849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.468793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:07.488657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 400/806] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:07.489980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3190c-f027-4767-ae98-f6988c80b3dc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.490970 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3190c-f027-4767-ae98-f6988c80b3dc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.491757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3190c-f027-4767-ae98-f6988c80b3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.517493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7eb3190c-f027-4767-ae98-f6988c80b3dc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:07.518784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7eb3190c-f027-4767-ae98-f6988c80b3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:07.534795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c1732-de1d-4868-872a-72a5416c25ea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.569052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.569844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.570153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.570437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.581596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.583234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.587248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 401/807] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:07.588172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3190c-f027-4767-ae98-f6988c80b3dc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:07.600308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:07.601378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:07.602428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:07.602428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:07.602428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:07.602428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:07.602428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 407/808] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:07.602428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.630782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:07.703287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89cb9-7d55-4e6b-9924-18489d843e24 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.706270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3190c-f027-4767-ae98-f6988c80b3dc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.719917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:07.735817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.736939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.736939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.737133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.737769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:07.738094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.739509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.739914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.740752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.741029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.741297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.751518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 408/809] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:07.752318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.752743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.754226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:07.773400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:07.774534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:07.775484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:07.775484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:07.775484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:07.775484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:07.775484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 402/810] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:07.775484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.840904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:07.855231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a68d94-a39a-42f5-9a57-b9b26216f028 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.883921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d285d5-84b7-49e0-8df2-fb0cfe42585f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:07.889402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.890240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.890525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.890800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.891448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.892796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:07.905245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:07.906251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:07.907095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 409/811] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:07.910892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.918052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:07.919301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:07.919655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:07.919932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:07.920657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:07.920960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:07.922323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:07.934103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 403/812] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:07.935069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:07.959809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:08.011123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde3743-0789-4320-8399-4a0a4a10688a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec80ee-8499-4cdf-8655-22da7100f372 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.045607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.046433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.046712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.046987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] PATH_INFO: `/v3/services/network` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.047642 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.049000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:08.061762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:08.062996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:08.063828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 410/813] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:07 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:08.064620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.074721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c311-6cc8-43ca-a7ae-40141a2595e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.075696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c311-6cc8-43ca-a7ae-40141a2595e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.075987 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c311-6cc8-43ca-a7ae-40141a2595e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.076264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c311-6cc8-43ca-a7ae-40141a2595e9 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/05a163118f6f44fdbad0c7c889970a7c/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.078263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c311-6cc8-43ca-a7ae-40141a2595e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=05a163118f6f44fdbad0c7c889970a7c, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.079594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:08.079739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c311-6cc8-43ca-a7ae-40141a2595e9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.136084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 404/814] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:43:07 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/05a163118f6f44fdbad0c7c889970a7c/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:43:08.136716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c311-6cc8-43ca-a7ae-40141a2595e9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.169529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c3c0a-ec8c-4499-a0e5-d68d7029b5de None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.209985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.210747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.211089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.211372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.212248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:08.212561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.214177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.235588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 411/815] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:08.235588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.260146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:08.280228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c311-6cc8-43ca-a7ae-40141a2595e9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.321985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.322677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.322960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.323237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.323946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:08.324254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.326409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.330601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:08.330992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 405/816] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:08.331857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.362923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927fc6a-ac18-4030-89b7-8c99d91da562 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.400041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b9673-c565-4607-899f-3794d281a794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.400892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b9673-c565-4607-899f-3794d281a794 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.401180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b9673-c565-4607-899f-3794d281a794 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.401455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b9673-c565-4607-899f-3794d281a794 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.410644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b9673-c565-4607-899f-3794d281a794 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.412894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b9673-c565-4607-899f-3794d281a794 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-423b9673-c565-4607-899f-3794d281a794 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:08.434115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:08.435288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:08.436393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:08.436393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:08.436393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:08.436393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:08.436393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:08.436393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:08.436393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:08.436393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:08.438022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26353a9-d065-43d3-90f4-cfdde567c2b6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.438692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 412/817] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:08.439643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b9673-c565-4607-899f-3794d281a794 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.479603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.480273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.480565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.481406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.482106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] RBAC: Adding query filter params (name=network) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:08.482408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.483755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.488584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 406/818] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:08.493820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.510408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:08.554974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b9673-c565-4607-899f-3794d281a794 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.593357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.594298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.594585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.594977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.597218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:08.603651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.604517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1bf78-dc10-4f53-a7dc-c955ddf0e83e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.605013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:08.621762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:08.622799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:08.623724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 413/819] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:08.624317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.646900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.647572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.647855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.648129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.649038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:08.649216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.650568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.660819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 407/820] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:08.660819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.739170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03deb7-f073-4298-8a55-05d09e81e5e8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.747946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:08.775664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf003d2-ca43-4a96-982f-08f700722cbb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.778086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.778820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.779113 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.779391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.780187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:08.780504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.782024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.794287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 414/821] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:08.795124 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.821587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.822211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.822500 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.822792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.823502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:08.823820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.825819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.835597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 408/822] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:08.835597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.866031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:08.915469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed152e9e-9e58-439c-9ef4-a5c926b161d1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.946759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69234c83-ca5e-48e3-9510-9577f8e43cb5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:08.949997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.950697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.950981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.951261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.952097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:08.952412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.953832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:08.971823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 415/823] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:43:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:08.972695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:08.989920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec177e54-2e3a-4de8-8ae9-81481981a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:08.990627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec177e54-2e3a-4de8-8ae9-81481981a4bf None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:08.990912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec177e54-2e3a-4de8-8ae9-81481981a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:08.991189 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec177e54-2e3a-4de8-8ae9-81481981a4bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:08.991930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec177e54-2e3a-4de8-8ae9-81481981a4bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:08.993272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec177e54-2e3a-4de8-8ae9-81481981a4bf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:09.003720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:09.071556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08046326-58c9-476c-8fa1-98144d969cb7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:09.085009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:09.102094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 409/824] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:43:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:09.103080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec177e54-2e3a-4de8-8ae9-81481981a4bf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:09.129658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7afc-ab86-40ae-9730-3af78f919b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:09.131224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7afc-ab86-40ae-9730-3af78f919b7e None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:09.131852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7afc-ab86-40ae-9730-3af78f919b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:09.132282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7afc-ab86-40ae-9730-3af78f919b7e None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/6a6d40d5beb849a0aa34a56efbe4b525/roles/68ca8a82d7b444d49fc01a6ad1de267b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:09.155224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7afc-ab86-40ae-9730-3af78f919b7e None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=6a6d40d5beb849a0aa34a56efbe4b525, role_id=68ca8a82d7b444d49fc01a6ad1de267b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:09.157554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7afc-ab86-40ae-9730-3af78f919b7e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:09.208808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 416/825] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:43:08 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/6a6d40d5beb849a0aa34a56efbe4b525/roles/68ca8a82d7b444d49fc01a6ad1de267b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:43:09.210418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7afc-ab86-40ae-9730-3af78f919b7e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:09.240659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec177e54-2e3a-4de8-8ae9-81481981a4bf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:09.310922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62582db5-60e9-4483-853f-49669b5b6bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:09.311743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62582db5-60e9-4483-853f-49669b5b6bbb None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:09.311913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62582db5-60e9-4483-853f-49669b5b6bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:09.312901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62582db5-60e9-4483-853f-49669b5b6bbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:09.312901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62582db5-60e9-4483-853f-49669b5b6bbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:09.314387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62582db5-60e9-4483-853f-49669b5b6bbb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:09.362413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7afc-ab86-40ae-9730-3af78f919b7e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:09.407049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 410/826] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:43:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:09.417450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103079b0-78b7-4fdf-b92c-6adfa4b68da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:09.418759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103079b0-78b7-4fdf-b92c-6adfa4b68da2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:09.419043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103079b0-78b7-4fdf-b92c-6adfa4b68da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:09.419320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103079b0-78b7-4fdf-b92c-6adfa4b68da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:09.449181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:09.501598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103079b0-78b7-4fdf-b92c-6adfa4b68da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:09.503092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103079b0-78b7-4fdf-b92c-6adfa4b68da2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:09.613840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 417/827] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:43:09.619475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62582db5-60e9-4483-853f-49669b5b6bbb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:09.677301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:09.730222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62582db5-60e9-4483-853f-49669b5b6bbb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:09.773515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:09.774363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:09.774649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:09.774923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:09.788086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:09.789534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:09.808382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:09.809949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:09.810859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:09.810859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:09.810859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:09.810859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:09.810859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 411/828] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:09.817008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103079b0-78b7-4fdf-b92c-6adfa4b68da2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:09.879443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:09.928024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103079b0-78b7-4fdf-b92c-6adfa4b68da2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:09.968698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:09.969368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:09.969650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:09.969921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:09.970724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:09.971030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:09.972393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:09.988494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 418/829] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:09.993906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:10.105055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9cd4d-9fff-46bd-b37b-33297c266370 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:10.107552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:10.140489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:10.141301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:10.141580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:10.141851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:10.148824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:10.150278 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:10.165513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:10.166488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:10.167446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 412/830] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:10.175409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:10.282090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91706bcd-7402-4615-bacf-b2c9a61d81c2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:10.296389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:10.316276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237b0ff-83c1-4c1a-9b1e-98e447e9100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:10.316936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237b0ff-83c1-4c1a-9b1e-98e447e9100e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:10.317217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237b0ff-83c1-4c1a-9b1e-98e447e9100e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:10.317494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237b0ff-83c1-4c1a-9b1e-98e447e9100e None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:10.318369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237b0ff-83c1-4c1a-9b1e-98e447e9100e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:10.318684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237b0ff-83c1-4c1a-9b1e-98e447e9100e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:10.320091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237b0ff-83c1-4c1a-9b1e-98e447e9100e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:10.332734 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 419/831] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:10.339142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:10.346560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f82a3-69c6-4d42-a322-2dae29b010ca None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:10.346854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f82a3-69c6-4d42-a322-2dae29b010ca None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:10.347132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f82a3-69c6-4d42-a322-2dae29b010ca None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:10.348723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 420/832] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:10.354620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5fbb-1761-41ce-a288-bde3e52a4e8e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:10.354908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5fbb-1761-41ce-a288-bde3e52a4e8e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:10.355185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d5fbb-1761-41ce-a288-bde3e52a4e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:10.376682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-083d5fbb-1761-41ce-a288-bde3e52a4e8e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:10.378208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-083d5fbb-1761-41ce-a288-bde3e52a4e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:10.456191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c468d-9450-4b97-bdc8-2298bab8ddff None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:10.470129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 421/833] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:10.490863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d5fbb-1761-41ce-a288-bde3e52a4e8e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:10.503455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:10.504431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:10.504915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:10.505390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:10.506684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=4ade274e49f748ee8e3bec2a963cf1b2) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:10.507226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:10.508888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:10.517406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 413/834] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:10 2022] GET /identity/v3/role_assignments?user.id=4ade274e49f748ee8e3bec2a963cf1b2&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:10.603561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d5fbb-1761-41ce-a288-bde3e52a4e8e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:10.606841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:10.641115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a8a66-99b2-4b55-afa8-80b153ef69c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:10.641924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a8a66-99b2-4b55-afa8-80b153ef69c3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:10.642334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a8a66-99b2-4b55-afa8-80b153ef69c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:10.642615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a8a66-99b2-4b55-afa8-80b153ef69c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:10.654889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a8a66-99b2-4b55-afa8-80b153ef69c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-bb2a8a66-99b2-4b55-afa8-80b153ef69c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:10.662657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:10.663609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:10.664456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 422/835] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:10.670761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:10.700491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:10.774264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab1858-05dc-4d15-b97f-06dd4e4a151a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:10.810989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:10.811657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:10.811938 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:10.812212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:10.812953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:10.813254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:10.814642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:10.827680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 414/836] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:10.833109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a8a66-99b2-4b55-afa8-80b153ef69c3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:10.937553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a8a66-99b2-4b55-afa8-80b153ef69c3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:10.971747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:10.972539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:10.972821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:10.973097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:10.984885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:10.986369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:11.004770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:11.005721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:11.006668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:11.006668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:11.006668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:11.006668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:11.006668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 423/837] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:11.011887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:11.109433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:11.121068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270a596-f8ec-4650-8618-06f484eb99f0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:11.159111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:11.159788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.160073 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.160350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.161082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:11.161389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:11.162769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:11.177512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 415/838] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:11.182617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:11.203010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:11.288107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed005f-6f87-4133-a02a-f59601f2a633 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:11.323230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b163e-2de9-4048-bc3d-d24b834732a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:11.324018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b163e-2de9-4048-bc3d-d24b834732a5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.324961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b163e-2de9-4048-bc3d-d24b834732a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.325447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b163e-2de9-4048-bc3d-d24b834732a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.332984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b163e-2de9-4048-bc3d-d24b834732a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:11.334454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b163e-2de9-4048-bc3d-d24b834732a5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-173b163e-2de9-4048-bc3d-d24b834732a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:11.349479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:11.351664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:11.353901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 424/839] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:11.359351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:11.395727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427e05-ebd2-4951-aff2-64d2300f27cf None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.396012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427e05-ebd2-4951-aff2-64d2300f27cf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.396180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427e05-ebd2-4951-aff2-64d2300f27cf None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.397550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 425/840] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:11.402755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4db2-55c7-4aa0-8a68-367e22f028ac None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.403044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4db2-55c7-4aa0-8a68-367e22f028ac None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.403413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4db2-55c7-4aa0-8a68-367e22f028ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.420027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cbbb4db2-55c7-4aa0-8a68-367e22f028ac None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:11.421253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cbbb4db2-55c7-4aa0-8a68-367e22f028ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:11.476454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78870f-960d-45fe-8583-1620b1f9ab7b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:11.493395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 426/841] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:11.498220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610ffd-26cd-4246-8696-2620d7c90299 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.498700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610ffd-26cd-4246-8696-2620d7c90299 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.499146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97610ffd-26cd-4246-8696-2620d7c90299 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.501043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 427/842] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:11.507262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff90d7b-468d-4fb4-8084-acbae2b99ab8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.507741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff90d7b-468d-4fb4-8084-acbae2b99ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.508242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff90d7b-468d-4fb4-8084-acbae2b99ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.519176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:11.519850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.520135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.520409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.521257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:11.521565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:11.521954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:11.523328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:11.527888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3ff90d7b-468d-4fb4-8084-acbae2b99ab8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:11.529177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3ff90d7b-468d-4fb4-8084-acbae2b99ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:11.546112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 416/843] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 22 08:43:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:11.546112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:11.554451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:11.614107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 428/844] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:11.614107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff90d7b-468d-4fb4-8084-acbae2b99ab8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:11.728506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff90d7b-468d-4fb4-8084-acbae2b99ab8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:11.762894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32df16-2677-46f1-821d-df6b859440e5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:11.765192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524cdfc-f15e-4876-8408-58085fcb8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:11.765844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524cdfc-f15e-4876-8408-58085fcb8931 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.766164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524cdfc-f15e-4876-8408-58085fcb8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.766439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524cdfc-f15e-4876-8408-58085fcb8931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.769928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:11.798653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:11.799441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.799722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.799995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.800644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:11.801989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:11.815302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:11.816383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:11.817251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 417/845] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:11.818035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:11.854797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524cdfc-f15e-4876-8408-58085fcb8931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:11.856784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524cdfc-f15e-4876-8408-58085fcb8931 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:11.898865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:11.932114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0d2542-d62b-4524-aa65-23303bd25161 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:11.966542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 429/846] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:43:11.966852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495204a-aa8d-4c90-9d64-548495cbecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:11.967705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495204a-aa8d-4c90-9d64-548495cbecd2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:11.967988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495204a-aa8d-4c90-9d64-548495cbecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:11.968265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495204a-aa8d-4c90-9d64-548495cbecd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:11.968592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524cdfc-f15e-4876-8408-58085fcb8931 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:11.982288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495204a-aa8d-4c90-9d64-548495cbecd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d495204a-aa8d-4c90-9d64-548495cbecd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:11.990248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:11.991162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:11.992000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 418/847] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:43:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:11.992713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495204a-aa8d-4c90-9d64-548495cbecd2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.013038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:12.082404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524cdfc-f15e-4876-8408-58085fcb8931 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.096234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495204a-aa8d-4c90-9d64-548495cbecd2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.119050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.119726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.120014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.120542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.121021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:12.121536 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.123137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.128009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 430/848] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:12.128862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.134942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:12.140951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.141929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.142257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.142749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.154190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.155763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:12.174280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:12.175323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:12.176235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:12.176235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:12.176235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:12.176235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:12.176235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 419/849] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:12.176524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.238280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:12.241601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab472-aa2b-46e2-9f22-f342aed0150b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.279303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.280056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.280345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.280623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.281379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:12.281693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.283124 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.287768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533070f-94fa-4ab7-8b08-a219eab68a91 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.297971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 431/850] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:12.297971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.323124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.323792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.324094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.324414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.325135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:12.325480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.326863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.340324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 420/851] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:12.340324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.407370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:12.427126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc63f8-c09c-4c6c-af38-882b19b1227c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.470282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.470761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.471049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.471332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.472149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:12.472385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.473794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.478041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b257-f511-4264-849a-94d597d84bd5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.492567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 432/852] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:12.493698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.522603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:12.526196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.527357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.528040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.528594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.544048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.545918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:12.570510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:12.571443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:12.572333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:12.572333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:12.572333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:12.572333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:12.572553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 421/853] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:12.578761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.620889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b0fea-fc92-4b86-a4a9-c0c03ab0c67f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.672506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.673319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.673605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.673883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.683058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.685496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.694996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:12.698916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2785b-9bde-46d5-92ab-13fae78b899d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:12.701640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:12.702534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:12.703424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:12.703424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:12.703424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:12.703424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:12.703424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:12.703424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:12.703424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:12.703424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:12.707996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 433/854] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:12.708997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.747534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032664c-7ea3-4ec8-8a96-e8b7f8eda27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.748811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032664c-7ea3-4ec8-8a96-e8b7f8eda27a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.750238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032664c-7ea3-4ec8-8a96-e8b7f8eda27a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.750739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032664c-7ea3-4ec8-8a96-e8b7f8eda27a None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.751702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032664c-7ea3-4ec8-8a96-e8b7f8eda27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:12.752194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032664c-7ea3-4ec8-8a96-e8b7f8eda27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.753722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032664c-7ea3-4ec8-8a96-e8b7f8eda27a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.774757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 422/855] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:12.776568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e815f84-bfae-4bb6-903e-dd6371b6e95e None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.776863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e815f84-bfae-4bb6-903e-dd6371b6e95e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.777142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e815f84-bfae-4bb6-903e-dd6371b6e95e None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.779184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 423/856] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:12.781891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e815f84-bfae-4bb6-903e-dd6371b6e95e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.808932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:12.828058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa13e1-4564-4410-be5b-e3f8a6399df6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.864504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8601a5-207d-4f7e-8f61-ce5c7d99b5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.864854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8601a5-207d-4f7e-8f61-ce5c7d99b5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.865144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8601a5-207d-4f7e-8f61-ce5c7d99b5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.865422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8601a5-207d-4f7e-8f61-ce5c7d99b5c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.866246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8601a5-207d-4f7e-8f61-ce5c7d99b5c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:12.866563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8601a5-207d-4f7e-8f61-ce5c7d99b5c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.867988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8601a5-207d-4f7e-8f61-ce5c7d99b5c1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.880716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 434/857] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:12.881964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa367-7bb5-4f20-87ab-74fe5bd61713 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.882284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa367-7bb5-4f20-87ab-74fe5bd61713 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.882570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa367-7bb5-4f20-87ab-74fe5bd61713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.900510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-76dfa367-7bb5-4f20-87ab-74fe5bd61713 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:12.901767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-76dfa367-7bb5-4f20-87ab-74fe5bd61713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:12.906753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e815f84-bfae-4bb6-903e-dd6371b6e95e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:12.941414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:12.942593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:12.942879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:12.943158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:12.951365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:12.952805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:12.968315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:12.969315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:12.970290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:12.974195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 424/858] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:12.975011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:12.982098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 435/859] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:12.982098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfa367-7bb5-4f20-87ab-74fe5bd61713 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:13.002906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:13.068221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:13.091779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c60e7a-6684-4bc8-87fc-ac9853339be8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:13.102665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfa367-7bb5-4f20-87ab-74fe5bd61713 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:13.129598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:13.130627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:13.131162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:13.131449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:13.132427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=05a163118f6f44fdbad0c7c889970a7c) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:13.132741 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:13.134860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:13.138794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:13.140005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:13.140567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:13.140854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:13.141701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:13.142012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:13.150433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 425/860] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/role_assignments?user.id=05a163118f6f44fdbad0c7c889970a7c&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:13.150433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:13.150696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:13.172919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 436/861] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 22 08:43:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:13.174376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:13.247739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:13.266775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441eb298-f0e6-4ed2-a48e-4f781b6f1754 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:13.285897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba1007-0d48-42c4-9803-62ef0847c4a4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:13.308571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:13.309512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:13.309866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:13.310173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:13.310829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:13.312393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:13.319268 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:13.327378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:13.336140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:13.336976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:13.337761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48464d92-2a5e-4186-a56b-ce6314aa022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:13.337851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 426/862] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Jun 22 08:43:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:13.337928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464d92-2a5e-4186-a56b-ce6314aa022f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:13.337928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464d92-2a5e-4186-a56b-ce6314aa022f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:13.337928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464d92-2a5e-4186-a56b-ce6314aa022f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:13.338148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:13.413506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48464d92-2a5e-4186-a56b-ce6314aa022f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:13.415034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48464d92-2a5e-4186-a56b-ce6314aa022f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:13.459948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6fbec-e866-4b36-ba06-cc56a274da83 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:13.504609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:13.506359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:13.506930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:13.507373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:13.508225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:13.508685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:13.510210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:13.517327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 427/863] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:13.523172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:13.541808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:13.549506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 437/864] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:43:13.558684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48464d92-2a5e-4186-a56b-ce6314aa022f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:13.581618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:13.637663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615c4a3-1b7d-47ac-87ca-80640693003b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:13.654711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48464d92-2a5e-4186-a56b-ce6314aa022f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:13.676491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:13.677164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:13.677544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:13.677849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:13.678578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:13.678887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:13.680338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:13.691332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 428/865] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:13.691962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:13.692989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:13.693414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:13.693828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:13.706687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:13.708456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:13.731281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:13.732437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:13.733519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:13.733519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:13.733519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:13.733519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:13.739996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 438/866] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:13.741712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:13.830434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:13.861086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dcc4b-5041-46c7-8e4b-bfaac5f93467 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:13.898005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:13.898706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:13.898987 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:13.899266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:13.900042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:13.900349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:13.901697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:13.918612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 429/867] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:13.921512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:14.006951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:14.025636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808f523-2221-4a53-8138-21cb9ae96628 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:14.061334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:14.062257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:14.062612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:14.062959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:14.069981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:14.071596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:14.086340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:14.087446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:14.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:14.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:14.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:14.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:14.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:14.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:14.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:14.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:14.094081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 439/868] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:14.095485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:14.199661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f459d9-1396-4936-9c06-11a1d460f66f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:14.235865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f56d94-eea5-401e-a74c-410c93ba217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:14.236833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56d94-eea5-401e-a74c-410c93ba217d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:14.237300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56d94-eea5-401e-a74c-410c93ba217d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:14.237784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f56d94-eea5-401e-a74c-410c93ba217d None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:14.238788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f56d94-eea5-401e-a74c-410c93ba217d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:14.239280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f56d94-eea5-401e-a74c-410c93ba217d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:14.240877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f56d94-eea5-401e-a74c-410c93ba217d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:14.243847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:14.255231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 430/869] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:14.266193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:14.365227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f55641-defc-4c93-bfaa-ab2ff1be0ba4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:14.403389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0038-8a01-4178-addb-ff8c352fdd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:14.404052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0038-8a01-4178-addb-ff8c352fdd54 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:14.404333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0038-8a01-4178-addb-ff8c352fdd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:14.404647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0038-8a01-4178-addb-ff8c352fdd54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:14.405552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0038-8a01-4178-addb-ff8c352fdd54 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=6a6d40d5beb849a0aa34a56efbe4b525) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:14.405863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0038-8a01-4178-addb-ff8c352fdd54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:14.407465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0038-8a01-4178-addb-ff8c352fdd54 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:14.422256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 440/870] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:14 2022] GET /identity/v3/role_assignments?user.id=6a6d40d5beb849a0aa34a56efbe4b525&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:14.503352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8274-ce8c-4469-9c2c-359538122abd None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:14.503870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8274-ce8c-4469-9c2c-359538122abd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:14.503971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8274-ce8c-4469-9c2c-359538122abd None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:14.505656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 431/871] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:14.511443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076094-b1d5-4bb8-b6a7-367cf9d8c9d1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:14.512642 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076094-b1d5-4bb8-b6a7-367cf9d8c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:14.513027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f076094-b1d5-4bb8-b6a7-367cf9d8c9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:14.525217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:14.531372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0f076094-b1d5-4bb8-b6a7-367cf9d8c9d1 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:14.532615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0f076094-b1d5-4bb8-b6a7-367cf9d8c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:14.610538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 441/872] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:14.634556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d8274-ce8c-4469-9c2c-359538122abd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:14.757667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d8274-ce8c-4469-9c2c-359538122abd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:14.795286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e7c07-a3cf-495a-9d68-3087482a0acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:14.795957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7c07-a3cf-495a-9d68-3087482a0acc None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:14.796244 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7c07-a3cf-495a-9d68-3087482a0acc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:14.796525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7c07-a3cf-495a-9d68-3087482a0acc None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:14.797261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e7c07-a3cf-495a-9d68-3087482a0acc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:14.798653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e7c07-a3cf-495a-9d68-3087482a0acc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:14.863563 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 432/873] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:43:14 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:15.343428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb489101-db26-4ac2-9045-23203e4c3bc8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:15.343813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb489101-db26-4ac2-9045-23203e4c3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:15.343995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb489101-db26-4ac2-9045-23203e4c3bc8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:15.345617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 442/874] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:15.350918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f504b7-4b05-4534-9617-397cc3c203e9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:15.351210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f504b7-4b05-4534-9617-397cc3c203e9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:15.351485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f504b7-4b05-4534-9617-397cc3c203e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:15.368971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-43f504b7-4b05-4534-9617-397cc3c203e9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:15.370176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-43f504b7-4b05-4534-9617-397cc3c203e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:15.424935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:15.454654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 433/875] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:15.477697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb489101-db26-4ac2-9045-23203e4c3bc8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:15.593319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb489101-db26-4ac2-9045-23203e4c3bc8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:15.629096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:15.629826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:15.630144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:15.630425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:15.631140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:15.632631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:15.635415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:15.646894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:15.655273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:15.656127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 443/876] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:15.656911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f504b7-4b05-4534-9617-397cc3c203e9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:15.764236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f504b7-4b05-4534-9617-397cc3c203e9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:15.799690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba370b4-049b-457b-b7ef-cfde28eb90bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:15.800353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba370b4-049b-457b-b7ef-cfde28eb90bb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:15.800642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba370b4-049b-457b-b7ef-cfde28eb90bb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:15.800918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba370b4-049b-457b-b7ef-cfde28eb90bb None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:15.801628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba370b4-049b-457b-b7ef-cfde28eb90bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:15.801936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba370b4-049b-457b-b7ef-cfde28eb90bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:15.803322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba370b4-049b-457b-b7ef-cfde28eb90bb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:15.808871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 434/877] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:15.814781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:15.922019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ffac5-ec87-497a-99fc-f5dbec83a2af None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:15.935526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbd5f4-5819-42d4-b1b2-4dd597dfaaab None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:15.935823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbd5f4-5819-42d4-b1b2-4dd597dfaaab None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:15.936088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbd5f4-5819-42d4-b1b2-4dd597dfaaab None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:15.937709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 435/878] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:15.943034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737a09-a03d-42c3-89e8-830c0f520800 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:15.943551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737a09-a03d-42c3-89e8-830c0f520800 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:15.944032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737a09-a03d-42c3-89e8-830c0f520800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:15.959570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:15.960239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:15.960529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:15.960807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:15.961514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:15.961822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:15.963214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:15.965339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-eb737a09-a03d-42c3-89e8-830c0f520800 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:15.967475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eb737a09-a03d-42c3-89e8-830c0f520800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:15.968648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 444/879] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:16.016356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:16.042258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 436/880] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:16.066489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:16.137993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:16.180388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f8e4b-d3df-4830-a2ad-60cea546b3c4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:16.216500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cbc1d-8a36-4f68-bec2-33286623a95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:16.217171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cbc1d-8a36-4f68-bec2-33286623a95b None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:16.217456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cbc1d-8a36-4f68-bec2-33286623a95b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:16.217734 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cbc1d-8a36-4f68-bec2-33286623a95b None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:16.218510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cbc1d-8a36-4f68-bec2-33286623a95b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:16.219878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cbc1d-8a36-4f68-bec2-33286623a95b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:16.320684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 445/881] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:43:16 2022] POST /identity/v3/services => generated 269 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:43:16.725788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bb693-3755-4794-b47b-e037e00235e6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:16.726337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bb693-3755-4794-b47b-e037e00235e6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:16.726337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bb693-3755-4794-b47b-e037e00235e6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:16.727971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 437/882] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:16.734909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4331-1772-4715-b9c3-610954d4c29c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:16.734909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4331-1772-4715-b9c3-610954d4c29c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:16.734909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4331-1772-4715-b9c3-610954d4c29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:16.753255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e8fe4331-1772-4715-b9c3-610954d4c29c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:16.754593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e8fe4331-1772-4715-b9c3-610954d4c29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:16.835252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 446/883] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:16.858861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bb693-3755-4794-b47b-e037e00235e6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:16.965136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bb693-3755-4794-b47b-e037e00235e6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.001949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b56664-4b3e-4598-8809-9b1a86b56c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.002801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56664-4b3e-4598-8809-9b1a86b56c98 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.003088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56664-4b3e-4598-8809-9b1a86b56c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.003365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b56664-4b3e-4598-8809-9b1a86b56c98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.014992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b56664-4b3e-4598-8809-9b1a86b56c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f7b56664-4b3e-4598-8809-9b1a86b56c98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:17.023272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:17.024177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:17.025461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 438/884] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 22 08:43:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:17.032473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4331-1772-4715-b9c3-610954d4c29c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.086044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:17.105865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3540c-69d3-4226-91f6-62b9777a5aad None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.106408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3540c-69d3-4226-91f6-62b9777a5aad None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.106778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3540c-69d3-4226-91f6-62b9777a5aad None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.108907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 439/885] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:17.113663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfebfd-b9e3-4f87-9a72-09b4b6425145 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.114343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfebfd-b9e3-4f87-9a72-09b4b6425145 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.114343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfebfd-b9e3-4f87-9a72-09b4b6425145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.133260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8cbfebfd-b9e3-4f87-9a72-09b4b6425145 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:17.134690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8cbfebfd-b9e3-4f87-9a72-09b4b6425145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:17.141085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4331-1772-4715-b9c3-610954d4c29c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.174576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:17.176602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.177494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.177996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.178487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.179425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:17.179926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.181478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.195511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 447/886] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:17.197097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.222157 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 440/887] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:17.245440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfebfd-b9e3-4f87-9a72-09b4b6425145 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.317670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23135ceb-9881-47ff-a86e-604e960f2d67 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.342527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:17.351859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfebfd-b9e3-4f87-9a72-09b4b6425145 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.362105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.362105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.362956 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.363688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.385133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.389249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.390191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.391060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.391469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.391763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.392548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.394050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:17.406798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:17.408697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:17.410772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:17.413098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 441/888] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:17.413994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:17.424990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:17.425934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:17.426853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:17.426853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:17.426853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:17.426853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:17.434101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 448/889] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:17.435678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.450509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:17.526029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7175e3a-0da4-483f-88a1-dd899964e7bc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.549024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aaf9e5-0a03-4e2b-ad0d-e94eaaa499d3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.564009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.564680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.564971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.565283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.565996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:17.566611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.567854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.578403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 442/890] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:17.579296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.593754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.594728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.595395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.595893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.596885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:17.597400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.599105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.619369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 449/891] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:17.622256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.648687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:17.683223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:17.690916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e79a6f-ddcf-470e-90f7-d388ebe7d57a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.727786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.728637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.728977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.729260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.729974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:17.730488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.732165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.736225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94097a04-21fc-4905-86be-9e4a79958163 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.742339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 443/892] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:17.744138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.773240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.774430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.774910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.775378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.783580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.785249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:17.800540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:17.801493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:17.802438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:17.810090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 450/893] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:17.812347 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.864990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9efc24-36db-4c69-9397-677235abdf0b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.904934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.905634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.906243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.906353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.907123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] RBAC: Adding query filter params (interface=public, service_id=ec6da858afcd4691b736f5681da729d0, region_id=RegionOne) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:17.907441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.908798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.909824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:17.920420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 444/894] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/endpoints?service_id=ec6da858afcd4691b736f5681da729d0&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:17.921379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:17.927829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b609c-a08c-44c8-8ce4-fe747bbd6246 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:17.947812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:17.964188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:17.965863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:17.966368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:17.966842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:17.967893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:17.968394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:17.980102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:17.993401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 451/895] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:17.995176 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:18.033693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e09d-8d39-4eb8-b6da-4ed0eb0e4add None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:18.071301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f74105-bbd6-4b58-93de-e232bdcf19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:18.071984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74105-bbd6-4b58-93de-e232bdcf19cd None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.072272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74105-bbd6-4b58-93de-e232bdcf19cd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.072548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74105-bbd6-4b58-93de-e232bdcf19cd None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.073238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f74105-bbd6-4b58-93de-e232bdcf19cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:18.075595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f74105-bbd6-4b58-93de-e232bdcf19cd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:18.090729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 445/896] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:43:18.106891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf19a9-cbab-4749-9773-dfda5573c347 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:18.153051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfcdf9-a741-4ba3-8930-c820e3f48e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:18.153968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfcdf9-a741-4ba3-8930-c820e3f48e09 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.154284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfcdf9-a741-4ba3-8930-c820e3f48e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.154566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfcdf9-a741-4ba3-8930-c820e3f48e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.170243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:18.231057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f416f2-6140-4093-8c84-d1dfdb5d616b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.231392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f416f2-6140-4093-8c84-d1dfdb5d616b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.231686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f416f2-6140-4093-8c84-d1dfdb5d616b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.233885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 446/897] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:18.239994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739bbb-e8b4-4a39-97f9-3f289b820cf9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.240801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739bbb-e8b4-4a39-97f9-3f289b820cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.241284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739bbb-e8b4-4a39-97f9-3f289b820cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.241387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfcdf9-a741-4ba3-8930-c820e3f48e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:18.242833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfcdf9-a741-4ba3-8930-c820e3f48e09 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:18.267164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-30739bbb-e8b4-4a39-97f9-3f289b820cf9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:18.268350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-30739bbb-e8b4-4a39-97f9-3f289b820cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:18.349598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 447/898] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:18.368609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 452/899] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:17 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:43:18.376875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30739bbb-e8b4-4a39-97f9-3f289b820cf9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:18.377137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfcdf9-a741-4ba3-8930-c820e3f48e09 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:18.399297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:18.429608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:18.492992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30739bbb-e8b4-4a39-97f9-3f289b820cf9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:18.495488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfcdf9-a741-4ba3-8930-c820e3f48e09 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:18.529994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1c831-cab0-420d-9a3e-bc33c6cde97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:18.530686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c831-cab0-420d-9a3e-bc33c6cde97a None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.530969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c831-cab0-420d-9a3e-bc33c6cde97a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.531244 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c831-cab0-420d-9a3e-bc33c6cde97a None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.531975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1c831-cab0-420d-9a3e-bc33c6cde97a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:18.533316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1c831-cab0-420d-9a3e-bc33c6cde97a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:18.533800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a7a29-364c-4879-ba63-b6ec34ab800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:18.534626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a7a29-364c-4879-ba63-b6ec34ab800a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.534912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a7a29-364c-4879-ba63-b6ec34ab800a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.535189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a7a29-364c-4879-ba63-b6ec34ab800a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.546795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a7a29-364c-4879-ba63-b6ec34ab800a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:18.554284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a7a29-364c-4879-ba63-b6ec34ab800a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-804a7a29-364c-4879-ba63-b6ec34ab800a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:18.566732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:18.567608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:18.568795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:18.568795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:18.568795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:18.568795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:18.568795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 453/900] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:18.569476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5d978-eb9b-4cec-9dc6-90e9fdc9d542 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.569762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5d978-eb9b-4cec-9dc6-90e9fdc9d542 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.570039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5d978-eb9b-4cec-9dc6-90e9fdc9d542 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.571468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 454/901] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:18.573731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5d978-eb9b-4cec-9dc6-90e9fdc9d542 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:18.611589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 448/902] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:43:18 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:18.613325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa37ad-1eeb-4e17-ab45-54d628a633b4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.613676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa37ad-1eeb-4e17-ab45-54d628a633b4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.614041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa37ad-1eeb-4e17-ab45-54d628a633b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.633656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e8fa37ad-1eeb-4e17-ab45-54d628a633b4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:18.634844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e8fa37ad-1eeb-4e17-ab45-54d628a633b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:18.701571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:18.717180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5d978-eb9b-4cec-9dc6-90e9fdc9d542 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:18.729288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 449/903] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:18.752692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa37ad-1eeb-4e17-ab45-54d628a633b4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:18.754969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:18.764190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:18.765571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.766052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.766511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.772764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:18.772764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:18.772764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:18.782897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 455/904] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:18.788882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:18.880985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa37ad-1eeb-4e17-ab45-54d628a633b4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:18.916598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23a38-9cd1-41f2-9ccf-02e30cc753d3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:18.932591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:18.934450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.934916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.935627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.936851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:18.938421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:18.954847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:18.955738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:18.956096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:18.956449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:18.956733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:18.957614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:18.958515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:18.964514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 450/905] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Jun 22 08:43:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:18.965480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:18.973371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:18.975664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:18.996566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:18.997485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:18.998401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:18.998401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:18.998401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:18.998401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:18.998401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:18.998401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:18.998401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:18.998401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:19.000899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 456/906] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:19.006639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:19.023246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:19.047281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:19.089550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1b92d-3f25-4dd4-bcf3-02de66ea6f15 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:19.128686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:19.129261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:19.129552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:19.129834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:19.130720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:19.131101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:19.132637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:19.139901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 451/907] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:19.146210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4a7cc-4c30-47df-af27-b634ef73a740 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:19.146358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:19.181087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:19.181747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:19.182028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:19.182346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:19.183166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:19.183684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:19.185108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:19.197254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 457/908] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:19.203955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:19.275290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85c49a-b15e-4c9c-8e19-0a5f1708b5f9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:19.290610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:19.311383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:19.315613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688dda7-a5b0-4789-9d2b-34c5ec7af955 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:19.318589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:19.318890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:19.319169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:19.319437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:19.322739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:19.323260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:19.325988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:19.333489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 452/909] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:19.342857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:19.358508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:19.359714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:19.360001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:19.360397 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:19.361223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] RBAC: Adding query filter params (role.id=05cf533ab06741a5899b787c8bb7ef55, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=6a6d40d5beb849a0aa34a56efbe4b525) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:19.361586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:19.363041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:19.378095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 458/910] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:19 2022] GET /identity/v3/role_assignments?user.id=6a6d40d5beb849a0aa34a56efbe4b525&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=05cf533ab06741a5899b787c8bb7ef55 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:19.462439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ee6c3-91f2-4334-b319-0539bee8ff3a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:19.499887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf671e7-3617-4689-92f8-37d451252749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:19.500608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf671e7-3617-4689-92f8-37d451252749 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:19.500894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf671e7-3617-4689-92f8-37d451252749 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:19.501169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf671e7-3617-4689-92f8-37d451252749 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:19.501975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf671e7-3617-4689-92f8-37d451252749 None admin] RBAC: Adding query filter params (interface=public, service_id=a8b0af3459fb4f62a4eea92583c6607e, region_id=RegionOne) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:19.502318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf671e7-3617-4689-92f8-37d451252749 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:19.503673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf671e7-3617-4689-92f8-37d451252749 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:19.509916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 453/911] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 22 08:43:19 2022] GET /identity/v3/endpoints?service_id=a8b0af3459fb4f62a4eea92583c6607e&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:19.516724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:19.628158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b7d53-1596-494e-a65d-de7161346c20 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:19.665211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dda25-34fa-494e-83c0-4967adf93769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:19.666272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dda25-34fa-494e-83c0-4967adf93769 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:19.666765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dda25-34fa-494e-83c0-4967adf93769 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:19.667240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dda25-34fa-494e-83c0-4967adf93769 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:19.669020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dda25-34fa-494e-83c0-4967adf93769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:19.670733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dda25-34fa-494e-83c0-4967adf93769 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:19.677430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 459/912] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:43:19 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:43:19.682087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:20.222454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237700f-d7c9-4e3c-961e-e8cfd2a6927f None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:20.222951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237700f-d7c9-4e3c-961e-e8cfd2a6927f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:20.222951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237700f-d7c9-4e3c-961e-e8cfd2a6927f None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:20.224743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 454/913] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:20.229820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5eb0-e3b2-4e68-aad9-7d568f059dcf None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:20.230783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5eb0-e3b2-4e68-aad9-7d568f059dcf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:20.231008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5eb0-e3b2-4e68-aad9-7d568f059dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:20.248126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9e4c5eb0-e3b2-4e68-aad9-7d568f059dcf None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:20.249297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9e4c5eb0-e3b2-4e68-aad9-7d568f059dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:20.317912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 460/914] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:20.341407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237700f-d7c9-4e3c-961e-e8cfd2a6927f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:20.407678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:20.453684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237700f-d7c9-4e3c-961e-e8cfd2a6927f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:20.489179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:20.489996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:20.490313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:20.490595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:20.491254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:20.492603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:20.505729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:20.506743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:20.507736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 455/915] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:20.514168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5eb0-e3b2-4e68-aad9-7d568f059dcf None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:20.628321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5eb0-e3b2-4e68-aad9-7d568f059dcf None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:20.663802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:20.674084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:20.674837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:20.675376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:20.675681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:20.676566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:20.676887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:20.678375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:20.684470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 461/916] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:20.693444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:20.803323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f861ca-5e59-4493-879a-5b3ba099beb8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:20.834703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:20.841118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ea68f-2ecb-4ff2-a162-935510b2f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:20.846101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea68f-2ecb-4ff2-a162-935510b2f429 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:20.846101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea68f-2ecb-4ff2-a162-935510b2f429 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:20.846101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ea68f-2ecb-4ff2-a162-935510b2f429 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:20.846101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea68f-2ecb-4ff2-a162-935510b2f429 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:20.846101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea68f-2ecb-4ff2-a162-935510b2f429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:20.846101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ea68f-2ecb-4ff2-a162-935510b2f429 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:20.850538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 456/917] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 22 08:43:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:20.861834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:20.872657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb861-0532-4366-a608-fb24fae5a05e None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:20.873067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb861-0532-4366-a608-fb24fae5a05e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:20.873369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb861-0532-4366-a608-fb24fae5a05e None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:20.875775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 457/918] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:20.881831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b2cf3-c299-42f8-813b-1ca600451c5b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:20.882161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b2cf3-c299-42f8-813b-1ca600451c5b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:20.882450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b2cf3-c299-42f8-813b-1ca600451c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:20.905711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-016b2cf3-c299-42f8-813b-1ca600451c5b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:20.907037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-016b2cf3-c299-42f8-813b-1ca600451c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:20.981991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfa739-d313-42a8-800e-b6fe4a66f6aa None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:20.984332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 458/919] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:21.012325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b2cf3-c299-42f8-813b-1ca600451c5b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:21.029757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6933db-74f0-47e2-a017-a305c636f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:21.030905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6933db-74f0-47e2-a017-a305c636f53e None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.031392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6933db-74f0-47e2-a017-a305c636f53e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.031935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6933db-74f0-47e2-a017-a305c636f53e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.032947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6933db-74f0-47e2-a017-a305c636f53e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:21.034707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6933db-74f0-47e2-a017-a305c636f53e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:21.120306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 462/920] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:43:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:21.140408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b2cf3-c299-42f8-813b-1ca600451c5b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:21.161702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:21.191030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:21.192328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.192774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.193287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.194489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:21.196225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:21.210777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:21.212153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:21.213227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:21.216853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 459/921] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:21.223228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6933db-74f0-47e2-a017-a305c636f53e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:21.280958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:21.346522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6933db-74f0-47e2-a017-a305c636f53e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:21.382230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a9c05-ff34-4d74-88af-334aa8701de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:21.383189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9c05-ff34-4d74-88af-334aa8701de4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.383653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9c05-ff34-4d74-88af-334aa8701de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.384084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9c05-ff34-4d74-88af-334aa8701de4 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.384943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a9c05-ff34-4d74-88af-334aa8701de4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:21.385391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a9c05-ff34-4d74-88af-334aa8701de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:21.386939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a9c05-ff34-4d74-88af-334aa8701de4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:21.393097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 463/922] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:21.398739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:21.479110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369aa3-7eab-4ebe-91fd-1f616cef117b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.479402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369aa3-7eab-4ebe-91fd-1f616cef117b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.479687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369aa3-7eab-4ebe-91fd-1f616cef117b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.482139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 464/923] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:21.487416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f97e76-5a6a-479e-8ead-8c32a82fde25 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.487708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f97e76-5a6a-479e-8ead-8c32a82fde25 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.487992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f97e76-5a6a-479e-8ead-8c32a82fde25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.507804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-68f97e76-5a6a-479e-8ead-8c32a82fde25 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:21.509268 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-68f97e76-5a6a-479e-8ead-8c32a82fde25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:21.513448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfc5b0-ba09-4c10-bcb0-7ae626712483 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:21.556205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:21.557113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.557555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.558035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.559581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:21.560045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:21.561888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:21.567620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 460/924] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:21.573790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:21.604326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 465/925] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:21.622974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:21.628651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f97e76-5a6a-479e-8ead-8c32a82fde25 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:21.674249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:21.691569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c24d-85ee-475f-9096-a0a6748c90cf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:21.743745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f97e76-5a6a-479e-8ead-8c32a82fde25 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:21.743971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:21.744937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.745745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.747308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.748385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] RBAC: Adding query filter params (interface=public, service_id=ebb65074fdf24a5da2d0f391089b8893, region_id=RegionOne) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:21.748922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:21.750545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:21.763906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 461/926] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 22 08:43:21 2022] GET /identity/v3/endpoints?service_id=ebb65074fdf24a5da2d0f391089b8893&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:21.765547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:21.787315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e8616-e9d8-442f-919a-091dfd5ce436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:21.788128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e8616-e9d8-442f-919a-091dfd5ce436 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.788413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e8616-e9d8-442f-919a-091dfd5ce436 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.788695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e8616-e9d8-442f-919a-091dfd5ce436 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.799669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e8616-e9d8-442f-919a-091dfd5ce436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-008e8616-e9d8-442f-919a-091dfd5ce436 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:21.807796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:21.809287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:21.810166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 466/927] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 22 08:43:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:21.812144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56997871-ec0f-457d-ab0a-0a37f82c02da None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.812144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56997871-ec0f-457d-ab0a-0a37f82c02da None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.812144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56997871-ec0f-457d-ab0a-0a37f82c02da None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.816575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 467/928] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:21.816575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56997871-ec0f-457d-ab0a-0a37f82c02da None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:21.888547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3aa53-6720-4757-a3b5-58b3bf9fb264 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:21.892028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:21.924609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fb47b-166b-4d77-8ea2-f9e2cfdd486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:21.925226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb47b-166b-4d77-8ea2-f9e2cfdd486a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.925514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb47b-166b-4d77-8ea2-f9e2cfdd486a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.925794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fb47b-166b-4d77-8ea2-f9e2cfdd486a None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.926515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb47b-166b-4d77-8ea2-f9e2cfdd486a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:21.927860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fb47b-166b-4d77-8ea2-f9e2cfdd486a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:21.929709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56997871-ec0f-457d-ab0a-0a37f82c02da None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:21.931417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:21.946105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 462/929] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:43:21 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:43:21.946105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b828b-f77f-45f8-b56c-35b3a2f398c3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.946105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b828b-f77f-45f8-b56c-35b3a2f398c3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.946105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b828b-f77f-45f8-b56c-35b3a2f398c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.955568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8e9b828b-f77f-45f8-b56c-35b3a2f398c3 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:21.956859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8e9b828b-f77f-45f8-b56c-35b3a2f398c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:21.981098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:21.982040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:21.982444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:21.982916 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:21.983928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:21.984389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:21.985993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.001742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 468/930] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 22 08:43:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:22.003023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.042089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 463/931] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:22.065620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b828b-f77f-45f8-b56c-35b3a2f398c3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.130843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6de2fc-e7cc-4e32-be71-7c2f9d492985 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.170278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:22.171077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:22.171366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:22.171647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:22.173733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:22.179104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b828b-f77f-45f8-b56c-35b3a2f398c3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.182511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:22.184042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:22.203193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:22.204162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:22.205667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:22.205667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:22.205667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:22.205667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:22.205667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 469/932] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:22.210455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.224121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:22.225015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:22.225240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:22.225483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:22.226208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:22.227584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.237343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:22.240944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:22.241867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:22.246933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 464/933] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Jun 22 08:43:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:22.249884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.348652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397322-3cba-4013-be76-608878c9d506 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.370591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3860-7dc7-4a69-96b5-9db761e33595 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.391132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:22.392114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:22.392598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:22.393064 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:22.393966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:22.394537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:22.395913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.412510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 470/934] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:22.418596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:22.419151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.419746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:22.420048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:22.420383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:22.421126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:22.421557 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:22.423300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.429232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 465/935] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:22.435526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.470260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:22.527730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:22.553006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcddf6-b930-4266-86d7-1384b63ff4c4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.563521 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21db5-56d2-4be1-a7c9-b34e71247edf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.594750 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:22.595510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:22.595981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:22.596333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:22.597307 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:22.597689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:22.599161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.607798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:22.608851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:22.609601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:22.609720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 466/936] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:22.610197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:22.610680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.619705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:22.622551 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:22.639370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:22.640345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:22.641290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:22.648709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 471/937] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:43:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:22.649724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.716952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:22.727553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729af8a-3045-4937-b99a-75faa76eda90 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.757304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feebbd4-96ae-41c4-838a-cea788780c5c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.766486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06054b-26d8-419c-b7cf-0cef861d4330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:22.767158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06054b-26d8-419c-b7cf-0cef861d4330 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:22.767446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06054b-26d8-419c-b7cf-0cef861d4330 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:22.767726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06054b-26d8-419c-b7cf-0cef861d4330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:22.768598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06054b-26d8-419c-b7cf-0cef861d4330 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:22.771337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06054b-26d8-419c-b7cf-0cef861d4330 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.797862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:22.798926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:22.799430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:22.799908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:22.800941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:22.801497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:22.803219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:22.806153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:22.824960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 472/938] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 22 08:43:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:22.830704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:22.886647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 467/939] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:43:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:22.952209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0731f82-aa1f-49b2-b509-255406835f7c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:22.999968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:23.000781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.001066 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.001344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.013756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:23.015394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:23.035384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:23.036337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:23.037233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:23.037233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:23.037233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:23.037233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:23.037233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 473/940] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:23.044767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06054b-26d8-419c-b7cf-0cef861d4330 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:23.158544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06054b-26d8-419c-b7cf-0cef861d4330 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:23.194109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5ad77-688c-4a91-9708-0b58a7b7dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:23.194777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ad77-688c-4a91-9708-0b58a7b7dfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.195066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ad77-688c-4a91-9708-0b58a7b7dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.195347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ad77-688c-4a91-9708-0b58a7b7dfa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.196073 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5ad77-688c-4a91-9708-0b58a7b7dfa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:23.196379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5ad77-688c-4a91-9708-0b58a7b7dfa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:23.197791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5ad77-688c-4a91-9708-0b58a7b7dfa2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:23.210825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 468/941] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:23.216824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:23.263589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:23.322457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a23d-a182-4fd3-8cc5-ccb8a43e0abc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:23.360245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:23.361867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.362370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.362857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.368484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497a8c-6202-46c3-b754-330226ac73c1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.368768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497a8c-6202-46c3-b754-330226ac73c1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.369044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66497a8c-6202-46c3-b754-330226ac73c1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.371202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 469/942] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:23.375364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:23.376180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f241-b88a-4cab-8f3b-2fc84b2cf2a8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.376468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f241-b88a-4cab-8f3b-2fc84b2cf2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.376745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8f241-b88a-4cab-8f3b-2fc84b2cf2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.377668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:23.388704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:23.393289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:23.394199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:23.395103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:23.395103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:23.395103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:23.395103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:23.395103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:23.395103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:23.395103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:23.395103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:23.395551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5dd8f241-b88a-4cab-8f3b-2fc84b2cf2a8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:23.396236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5dd8f241-b88a-4cab-8f3b-2fc84b2cf2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:23.397750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 474/943] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:23.405838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:23.477035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 470/944] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:23.501562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8f241-b88a-4cab-8f3b-2fc84b2cf2a8 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:23.527623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf884-2c17-4102-8b74-cbbe6d690e91 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:23.530527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:23.564510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:23.565564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.566076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.566757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.577253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:23.577253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:23.577253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:23.591936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 475/945] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:23.593055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:23.626757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8f241-b88a-4cab-8f3b-2fc84b2cf2a8 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:23.668041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:23.668703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.668978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.669245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.670265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:23.671550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:23.672845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING keystone.server.flask.common [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 08:43:23.677890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:23.708246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7def179-c481-4917-9ab0-ee4dbf68e087 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:23.732359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.sql.core [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:43:23.732359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 08:43:23.732359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [parameters: {'id': 'd0619132d9d44b47b7c6d43da262b388', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 08:43:23.732359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80310) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d0619132d9d44b47b7c6d43da262b388.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d0619132d9d44b47b7c6d43da262b388. Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:43:23.739934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 08:43:23.740725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application yield resource Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise self.value Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application session.commit() Jun 22 08:43:23.741700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:43:23.743170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:43:23.744338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:43:23.746570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [parameters: {'id': 'd0619132d9d44b47b7c6d43da262b388', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:23.748831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:23.750746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d0619132d9d44b47b7c6d43da262b388. Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 471/946] 10.222.0.36 () {60 vars in 1140 bytes} [Wed Jun 22 08:43:23 2022] POST /identity/v3/projects => generated 262 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:23.754645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:23.769725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eda579-1076-424f-b7fc-0878a0746b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:23.771165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda579-1076-424f-b7fc-0878a0746b4f None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.771992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda579-1076-424f-b7fc-0878a0746b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.772463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eda579-1076-424f-b7fc-0878a0746b4f None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/6a6d40d5beb849a0aa34a56efbe4b525/roles/05cf533ab06741a5899b787c8bb7ef55` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.775432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eda579-1076-424f-b7fc-0878a0746b4f None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=6a6d40d5beb849a0aa34a56efbe4b525, role_id=05cf533ab06741a5899b787c8bb7ef55)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:23.777520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eda579-1076-424f-b7fc-0878a0746b4f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:23.852791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 476/947] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:43:23 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/6a6d40d5beb849a0aa34a56efbe4b525/roles/05cf533ab06741a5899b787c8bb7ef55 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:43:23.883361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0e267-e7da-44dc-bff3-044d2d7c6fce None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:23.924848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02951fce-fb90-4057-a368-507b51ea8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:23.926028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951fce-fb90-4057-a368-507b51ea8cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:23.926567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951fce-fb90-4057-a368-507b51ea8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:23.927034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02951fce-fb90-4057-a368-507b51ea8cf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:23.935728 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02951fce-fb90-4057-a368-507b51ea8cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:23.937764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02951fce-fb90-4057-a368-507b51ea8cf9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-02951fce-fb90-4057-a368-507b51ea8cf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:23.954498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:23.955474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:23.956353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:23.956353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:23.956353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:23.956353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:23.956353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:23.956353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:23.956353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:23.956353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:23.958661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 472/948] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:23.967837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eda579-1076-424f-b7fc-0878a0746b4f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:23.993196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:24.076418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eda579-1076-424f-b7fc-0878a0746b4f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:24.113614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1268e9-abf6-438c-a119-190301e2a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:24.114707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1268e9-abf6-438c-a119-190301e2a455 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:24.115197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1268e9-abf6-438c-a119-190301e2a455 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:24.115690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1268e9-abf6-438c-a119-190301e2a455 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:24.116684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1268e9-abf6-438c-a119-190301e2a455 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:24.117210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1268e9-abf6-438c-a119-190301e2a455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:24.118922 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1268e9-abf6-438c-a119-190301e2a455 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:24.139484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 477/949] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:24.156046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65025-72f4-476b-b1b3-2a0828359128 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:24.156366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65025-72f4-476b-b1b3-2a0828359128 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:24.156616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65025-72f4-476b-b1b3-2a0828359128 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:24.161311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 473/950] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:24.167186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3515a-074e-4262-9155-2b7923b45b91 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:24.168252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3515a-074e-4262-9155-2b7923b45b91 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:24.168720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3515a-074e-4262-9155-2b7923b45b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:24.187506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3ae3515a-074e-4262-9155-2b7923b45b91 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:24.188744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3ae3515a-074e-4262-9155-2b7923b45b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:24.267640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 478/951] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:24.292012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65025-72f4-476b-b1b3-2a0828359128 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:24.352137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:24.407896 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65025-72f4-476b-b1b3-2a0828359128 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:24.444989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:24.445796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:24.446092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:24.446383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:24.447032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:24.448380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:24.461467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:24.462782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:24.463694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 474/952] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:24.471651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3515a-074e-4262-9155-2b7923b45b91 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:24.487428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:24.579965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3515a-074e-4262-9155-2b7923b45b91 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:24.623509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:24.624187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:24.624472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:24.624747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:24.625463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:24.625847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:24.627160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:24.632963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 479/953] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:24.639147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:24.747954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d7d4d-9f24-46f2-bdd9-41eeea1a1779 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:24.778421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:24.783413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7006379-b43a-4963-bd1f-c9d5f0b951c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:24.784078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006379-b43a-4963-bd1f-c9d5f0b951c9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:24.784358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006379-b43a-4963-bd1f-c9d5f0b951c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:24.784622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006379-b43a-4963-bd1f-c9d5f0b951c9 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:24.785451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7006379-b43a-4963-bd1f-c9d5f0b951c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:24.785763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7006379-b43a-4963-bd1f-c9d5f0b951c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:24.787189 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7006379-b43a-4963-bd1f-c9d5f0b951c9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:24.793199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 475/954] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:24.799153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:24.890998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:24.914001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fbd41-18db-4a94-a688-05ad331cc699 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:24.950247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242592ae-4481-4cb9-a38a-3574a281f351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:24.950910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242592ae-4481-4cb9-a38a-3574a281f351 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:24.951192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242592ae-4481-4cb9-a38a-3574a281f351 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:24.951465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242592ae-4481-4cb9-a38a-3574a281f351 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:24.952207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242592ae-4481-4cb9-a38a-3574a281f351 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:24.953627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242592ae-4481-4cb9-a38a-3574a281f351 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:25.029276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 480/955] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:43:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:25.072383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dc147-a05b-4586-944a-3fe5aa6971f6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:25.072714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dc147-a05b-4586-944a-3fe5aa6971f6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:25.072948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dc147-a05b-4586-944a-3fe5aa6971f6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:25.074893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 476/956] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:25.080648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626add-9f02-4566-8872-64eae4a1dde0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:25.080986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626add-9f02-4566-8872-64eae4a1dde0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:25.081221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23626add-9f02-4566-8872-64eae4a1dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:25.101226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-23626add-9f02-4566-8872-64eae4a1dde0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:25.102601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-23626add-9f02-4566-8872-64eae4a1dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:25.185866 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 481/957] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:25.209262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dc147-a05b-4586-944a-3fe5aa6971f6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:25.318673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dc147-a05b-4586-944a-3fe5aa6971f6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:25.354908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:25.356222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:25.356733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:25.357224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:25.358087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:25.359636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:25.371920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:25.373012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:25.373851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:25.376690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 477/958] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:25.382614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23626add-9f02-4566-8872-64eae4a1dde0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:25.446426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:25.489037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23626add-9f02-4566-8872-64eae4a1dde0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:25.526227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da42916-4c86-48c3-a290-d2b098fd2d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:25.527794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da42916-4c86-48c3-a290-d2b098fd2d82 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:25.528375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da42916-4c86-48c3-a290-d2b098fd2d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:25.528856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da42916-4c86-48c3-a290-d2b098fd2d82 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:25.529759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da42916-4c86-48c3-a290-d2b098fd2d82 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:25.530318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da42916-4c86-48c3-a290-d2b098fd2d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:25.531894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da42916-4c86-48c3-a290-d2b098fd2d82 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:25.537319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 482/959] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:25.544081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:25.598628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:25.659291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ac162-d872-4e73-95c2-c4ddf603a910 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:25.700499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa3e42-db04-49fa-8373-8e4ade65aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:25.701174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3e42-db04-49fa-8373-8e4ade65aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:25.701460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3e42-db04-49fa-8373-8e4ade65aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:25.701739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa3e42-db04-49fa-8373-8e4ade65aaa7 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:25.702482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3e42-db04-49fa-8373-8e4ade65aaa7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:25.702791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3e42-db04-49fa-8373-8e4ade65aaa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:25.704146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa3e42-db04-49fa-8373-8e4ade65aaa7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:25.709362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 478/960] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:26.081668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266647c-80ef-4adc-9e78-ff41c680f959 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.082091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266647c-80ef-4adc-9e78-ff41c680f959 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.082285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266647c-80ef-4adc-9e78-ff41c680f959 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.083913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 483/961] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:26.089707 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16f19-0a43-4945-8f86-c099baebe649 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.090263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16f19-0a43-4945-8f86-c099baebe649 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.090704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe16f19-0a43-4945-8f86-c099baebe649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.107819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4fe16f19-0a43-4945-8f86-c099baebe649 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:26.109330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4fe16f19-0a43-4945-8f86-c099baebe649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:26.180197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 479/962] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:26.205832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266647c-80ef-4adc-9e78-ff41c680f959 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:26.317342 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266647c-80ef-4adc-9e78-ff41c680f959 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:26.342425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:26.356309 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f082c39-6d94-4f1c-bddb-225ae7d0cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:26.360912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082c39-6d94-4f1c-bddb-225ae7d0cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.360912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082c39-6d94-4f1c-bddb-225ae7d0cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.360912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f082c39-6d94-4f1c-bddb-225ae7d0cb1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.369302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f082c39-6d94-4f1c-bddb-225ae7d0cb1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:26.376030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7190e1-298f-4462-807d-2d5ba3e44d06 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.376532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7190e1-298f-4462-807d-2d5ba3e44d06 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.376967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7190e1-298f-4462-807d-2d5ba3e44d06 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.378791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 480/963] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5f082c39-6d94-4f1c-bddb-225ae7d0cb1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:26.382948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:26.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:26.384730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 484/964] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 22 08:43:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:26.389131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be481a4-e958-4295-9e19-44e6c61fc454 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.389471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be481a4-e958-4295-9e19-44e6c61fc454 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.389751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be481a4-e958-4295-9e19-44e6c61fc454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.395097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f082c39-6d94-4f1c-bddb-225ae7d0cb1a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:26.408287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6be481a4-e958-4295-9e19-44e6c61fc454 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:26.409572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6be481a4-e958-4295-9e19-44e6c61fc454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:26.446076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:26.502137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 481/965] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:26.518677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f082c39-6d94-4f1c-bddb-225ae7d0cb1a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:26.520825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be481a4-e958-4295-9e19-44e6c61fc454 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:26.557519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:26.558832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.559078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.559357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.560094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:26.560435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:26.561754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:26.577998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 485/966] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 22 08:43:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:26.579163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:26.630806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:26.637671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be481a4-e958-4295-9e19-44e6c61fc454 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:26.681326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:26.681980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.682292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.682569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.684389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:26.686089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:26.695654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280217e-1df8-4d88-9e45-d0477842ba05 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:26.733699 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:26.734951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.735363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.sql.core [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:43:26.735363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 08:43:26.735363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [parameters: {'user_id': '438acb208462484f9e3b62aa8a415dff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 08:43:26.735363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80310) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 08:43:26.735909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.736384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jun 22 08:43:26.743723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:43:26.744612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application yield resource Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application next(self.gen) Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise self.value Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application session.commit() Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 08:43:26.745848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.session.flush() Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application compat.raise_( Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 08:43:26.747062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 08:43:26.747984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application conn.query(q) Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application result.read() Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 08:43:26.748929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [parameters: {'user_id': '438acb208462484f9e3b62aa8a415dff', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:26.749777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 08:43:26.752485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 08:43:26.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 08:43:26.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 08:43:26.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 08:43:26.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 08:43:26.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 08:43:26.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:26.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 482/967] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 22 08:43:26 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:26.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:26.760575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:26.763466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:26.784591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:26.785513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:26.786461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:26.786461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:26.786461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:26.786461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:26.788516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 486/968] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:26.789648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:26.794351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:26.878579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d910f-efa9-4398-ac29-da1dbd8a6261 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:26.911210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:26.915130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:26.916047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.916439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.916800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.919908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198953e3-031f-4df1-b635-7956acdf6c88 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:26.925776 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:26.927555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:26.942515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:26.943758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 08:43:26.944722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:26.945335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 483/969] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:43:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:26.951403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:26.962966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:26.963893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:26.965146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:26.965804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:26.967015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:26.967649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:26.969211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:26.983090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 487/970] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:26.988854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:27.059291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:27.069869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828c3f-2246-4f99-a2e5-a687b95ef2dc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:27.107206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:27.107994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.108369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.108764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.109695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:27.110086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:27.111587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:27.117067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827d6f1-8da4-46d9-bce6-51f6c4f7f474 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:27.154724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 484/971] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 22 08:43:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:27.165565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d75f52-dbcf-4500-8145-40c3cbba8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:27.166362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d75f52-dbcf-4500-8145-40c3cbba8c30 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.166651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d75f52-dbcf-4500-8145-40c3cbba8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.167202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d75f52-dbcf-4500-8145-40c3cbba8c30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.177819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d75f52-dbcf-4500-8145-40c3cbba8c30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:27.179339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d75f52-dbcf-4500-8145-40c3cbba8c30 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-43d75f52-dbcf-4500-8145-40c3cbba8c30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:27.197230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:27.198298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:27.200083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 488/972] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:43:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:27.205374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:27.317172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a35c25-3a75-494b-b7fb-eab2d978a050 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:27.343638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8a8c3-5793-4169-8c4b-40c7f3f257ce None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.343936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8a8c3-5793-4169-8c4b-40c7f3f257ce None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.344201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8a8c3-5793-4169-8c4b-40c7f3f257ce None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.345577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 489/973] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:27.351010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851156c-2389-4cc8-9660-2521c4025e3c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.351398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851156c-2389-4cc8-9660-2521c4025e3c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.351687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851156c-2389-4cc8-9660-2521c4025e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.353825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:27.354561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.355542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.355820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.356674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:27.356989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:27.358433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:27.372962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8851156c-2389-4cc8-9660-2521c4025e3c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:27.374185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8851156c-2389-4cc8-9660-2521c4025e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:27.378009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 485/974] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 22 08:43:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:27.382918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:27.387933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:27.396112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:27.456881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 490/975] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:27.481722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851156c-2389-4cc8-9660-2521c4025e3c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:27.499067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140a44f-93ea-4436-baca-db0c2d2eba60 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:27.537956 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6f64-41b6-48a2-9ab9-e76e7f59c92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:27.538867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6f64-41b6-48a2-9ab9-e76e7f59c92e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.539341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6f64-41b6-48a2-9ab9-e76e7f59c92e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.539782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c6f64-41b6-48a2-9ab9-e76e7f59c92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.588425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851156c-2389-4cc8-9660-2521c4025e3c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:27.619689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c6f64-41b6-48a2-9ab9-e76e7f59c92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:27.621999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c6f64-41b6-48a2-9ab9-e76e7f59c92e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:27.625473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:27.626344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.626632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.626910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.627563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:27.628917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:27.630166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:27.641741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:27.649227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:27.650295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 491/976] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:27.651086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:27.661638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:27.732635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 486/977] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:27 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:43:27.738160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6f64-41b6-48a2-9ab9-e76e7f59c92e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:27.755950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813469fe-0d6a-41d8-88d9-cda658da5507 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:27.791699 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:27.792523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.792810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.793088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.793802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:27.794143 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:27.795506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:27.805009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 492/978] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:27.805987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:27.848006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c6f64-41b6-48a2-9ab9-e76e7f59c92e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:27.855532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:27.882154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020eac6-219d-4eaf-852b-8de37b54ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:27.882941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020eac6-219d-4eaf-852b-8de37b54ad18 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.883222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020eac6-219d-4eaf-852b-8de37b54ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.883496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020eac6-219d-4eaf-852b-8de37b54ad18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.883806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:27.894415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020eac6-219d-4eaf-852b-8de37b54ad18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:27.895835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020eac6-219d-4eaf-852b-8de37b54ad18 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:27.909384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dd141-659d-4233-a42f-4c70d7b3ba18 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b020eac6-219d-4eaf-852b-8de37b54ad18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:27.914434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:27.915504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:27.916564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:27.916564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:27.916564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:27.916564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:27.916564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 487/979] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:27.917696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63f81-862e-43ab-b1b0-a795f4570872 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.918024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63f81-862e-43ab-b1b0-a795f4570872 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.918327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e63f81-862e-43ab-b1b0-a795f4570872 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.919596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 488/980] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:27.921162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e63f81-862e-43ab-b1b0-a795f4570872 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:27.946436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897ac30-a9f4-4834-a1dd-ef40054a5953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:27.947096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897ac30-a9f4-4834-a1dd-ef40054a5953 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.947378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897ac30-a9f4-4834-a1dd-ef40054a5953 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.947653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897ac30-a9f4-4834-a1dd-ef40054a5953 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.948395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897ac30-a9f4-4834-a1dd-ef40054a5953 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:27.949191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897ac30-a9f4-4834-a1dd-ef40054a5953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:27.950594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897ac30-a9f4-4834-a1dd-ef40054a5953 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:27.955415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 493/981] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:27.956501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8c0f-334c-4334-8c32-be5adfea6bf0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:27.956786 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8c0f-334c-4334-8c32-be5adfea6bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:27.957064 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b8c0f-334c-4334-8c32-be5adfea6bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:27.972912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-873b8c0f-334c-4334-8c32-be5adfea6bf0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:27.974103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-873b8c0f-334c-4334-8c32-be5adfea6bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:28.025711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e63f81-862e-43ab-b1b0-a795f4570872 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:28.039875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 494/982] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:28.054207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8c0f-334c-4334-8c32-be5adfea6bf0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:28.064901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:28.065647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:28.065935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:28.066250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:28.066973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:28.067378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:28.068635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:28.080713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 489/983] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:28.081491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:28.100619 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:28.106311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:28.139284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b8c0f-334c-4334-8c32-be5adfea6bf0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:28.173498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:28.174181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:28.174464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:28.174736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:28.175528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] RBAC: Adding query filter params (interface=admin, service_id=ebb65074fdf24a5da2d0f391089b8893, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:28.175842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:28.177214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:28.180415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc105-950d-4956-9a5d-bd97b5fe599c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:28.184731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 495/984] 10.222.0.36 () {56 vars in 1249 bytes} [Wed Jun 22 08:43:28 2022] GET /identity/v3/endpoints?service_id=ebb65074fdf24a5da2d0f391089b8893&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:28.185513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:28.214646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299323-ef95-4ff5-8c76-1f2f5912effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:28.215396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299323-ef95-4ff5-8c76-1f2f5912effc None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:28.215679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299323-ef95-4ff5-8c76-1f2f5912effc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:28.215951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299323-ef95-4ff5-8c76-1f2f5912effc None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:28.216665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5299323-ef95-4ff5-8c76-1f2f5912effc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:28.218006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5299323-ef95-4ff5-8c76-1f2f5912effc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:28.285718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec39c36-aa7f-4504-8aea-c748cb3fb4ae None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:28.306886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 490/985] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:43:28 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:28.310835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299323-ef95-4ff5-8c76-1f2f5912effc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:28.315076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:28.330318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:28.330976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:28.331315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:28.331704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:28.340287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:28.341795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:28.357398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:28.358761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:28.359826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 496/986] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:28.364605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:28.408266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:28.435567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5299323-ef95-4ff5-8c76-1f2f5912effc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:28.479821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ecdb-6896-4cc8-a4cd-be9a256ac672 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:28.480225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba829884-ef64-4f6e-8e91-e16e3572a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:28.481463 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba829884-ef64-4f6e-8e91-e16e3572a37d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:28.481463 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba829884-ef64-4f6e-8e91-e16e3572a37d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:28.481463 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba829884-ef64-4f6e-8e91-e16e3572a37d None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:28.482150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba829884-ef64-4f6e-8e91-e16e3572a37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:28.484050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba829884-ef64-4f6e-8e91-e16e3572a37d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:28.492417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 491/987] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:43:28 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:43:28.522368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a16bc-1896-4a1a-a038-6d44a8288afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:28.523065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a16bc-1896-4a1a-a038-6d44a8288afc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:28.523348 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a16bc-1896-4a1a-a038-6d44a8288afc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:28.524038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a16bc-1896-4a1a-a038-6d44a8288afc None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:28.524430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a16bc-1896-4a1a-a038-6d44a8288afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:28.524744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a16bc-1896-4a1a-a038-6d44a8288afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:28.526260 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a16bc-1896-4a1a-a038-6d44a8288afc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:28.549261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 497/988] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:28.553208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba829884-ef64-4f6e-8e91-e16e3572a37d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:28.670917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba829884-ef64-4f6e-8e91-e16e3572a37d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:28.707269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c9c94-d239-4074-8e86-19a6bf7fc26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:28.707937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c9c94-d239-4074-8e86-19a6bf7fc26e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:28.708220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c9c94-d239-4074-8e86-19a6bf7fc26e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:28.708496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c9c94-d239-4074-8e86-19a6bf7fc26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:28.709331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c9c94-d239-4074-8e86-19a6bf7fc26e None admin] RBAC: Adding query filter params (role.id=05cf533ab06741a5899b787c8bb7ef55, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=6a6d40d5beb849a0aa34a56efbe4b525) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:28.709643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c9c94-d239-4074-8e86-19a6bf7fc26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:28.711094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c9c94-d239-4074-8e86-19a6bf7fc26e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:28.722149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 492/989] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:28 2022] GET /identity/v3/role_assignments?user.id=6a6d40d5beb849a0aa34a56efbe4b525&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=05cf533ab06741a5899b787c8bb7ef55 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:30.406333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1af4-ab8a-4706-8644-0ff227cbc50c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.406864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1af4-ab8a-4706-8644-0ff227cbc50c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.406864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1af4-ab8a-4706-8644-0ff227cbc50c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.408297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 498/990] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:30.413528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399dbf2-a08f-45ae-81a1-5b47c4650888 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.413955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399dbf2-a08f-45ae-81a1-5b47c4650888 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.414155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399dbf2-a08f-45ae-81a1-5b47c4650888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.426301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:30.432034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c399dbf2-a08f-45ae-81a1-5b47c4650888 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:30.433612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c399dbf2-a08f-45ae-81a1-5b47c4650888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:30.507287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 493/991] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:30.548851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a1af4-ab8a-4706-8644-0ff227cbc50c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:30.573995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0b42-c48e-4b0b-a82a-cf54691e7ced None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.574371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0b42-c48e-4b0b-a82a-cf54691e7ced None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.574617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c0b42-c48e-4b0b-a82a-cf54691e7ced None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.576118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 494/992] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:30.580875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c67fc-59c1-41c5-817a-7d3e6ebaeade None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.581160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c67fc-59c1-41c5-817a-7d3e6ebaeade None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.581438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c67fc-59c1-41c5-817a-7d3e6ebaeade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.599899 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9b6c67fc-59c1-41c5-817a-7d3e6ebaeade None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:30.601081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9b6c67fc-59c1-41c5-817a-7d3e6ebaeade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:30.602078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:30.658496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a1af4-ab8a-4706-8644-0ff227cbc50c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:30.675702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 495/993] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:30.697120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:30.698374 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.698726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c67fc-59c1-41c5-817a-7d3e6ebaeade None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:30.698852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.699324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.699990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:30.701352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:30.713470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:30.714628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:30.715451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:30.718207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 499/994] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:30.720837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:30.777940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:30.813314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c67fc-59c1-41c5-817a-7d3e6ebaeade None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:30.827909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf7047-dc8a-4240-91c5-b8c44f85a6a3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:30.840779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:30.850380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a76d8c-f73f-4555-afa3-4e6c2d657be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:30.851191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76d8c-f73f-4555-afa3-4e6c2d657be0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.851479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76d8c-f73f-4555-afa3-4e6c2d657be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.851758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76d8c-f73f-4555-afa3-4e6c2d657be0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.856140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a76d8c-f73f-4555-afa3-4e6c2d657be0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:30.856140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a76d8c-f73f-4555-afa3-4e6c2d657be0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:30.861426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540d4e-eddc-4de4-9579-aa1ac91cddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:30.862100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540d4e-eddc-4de4-9579-aa1ac91cddad None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.862388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540d4e-eddc-4de4-9579-aa1ac91cddad None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.862664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540d4e-eddc-4de4-9579-aa1ac91cddad None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.863398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08540d4e-eddc-4de4-9579-aa1ac91cddad None admin] RBAC: Adding query filter params (name=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:30.863707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08540d4e-eddc-4de4-9579-aa1ac91cddad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:30.865205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08540d4e-eddc-4de4-9579-aa1ac91cddad None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-d0a76d8c-f73f-4555-afa3-4e6c2d657be0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:30.865926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:30.867071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:30.868107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 496/995] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 22 08:43:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:30.869147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d48f-7bfd-4d92-8cee-96db283518a0 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.869147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d48f-7bfd-4d92-8cee-96db283518a0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.869147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841d48f-7bfd-4d92-8cee-96db283518a0 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.870992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 497/996] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:30.873370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841d48f-7bfd-4d92-8cee-96db283518a0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:30.877457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 500/997] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:30.878645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f101ac-7ecb-436d-b1ff-f719856d8c49 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:30.878930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f101ac-7ecb-436d-b1ff-f719856d8c49 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:30.879207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f101ac-7ecb-436d-b1ff-f719856d8c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:30.896264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-53f101ac-7ecb-436d-b1ff-f719856d8c49 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:30.897478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-53f101ac-7ecb-436d-b1ff-f719856d8c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:30.963074 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 501/998] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:30.963916 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f101ac-7ecb-436d-b1ff-f719856d8c49 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:30.975424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841d48f-7bfd-4d92-8cee-96db283518a0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.005313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:31.012072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.012766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.013374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.013374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.013992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:31.014324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.015692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.020405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 498/999] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:31.021184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:31.067170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f101ac-7ecb-436d-b1ff-f719856d8c49 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.077854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:31.104465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.105213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.105502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.105792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.106739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:31.107208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.108857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.113580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 502/1000] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:31.114377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:31.124788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bc66b-7664-4c20-b91b-bdc232a0068b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.160432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.161221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.161501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.161773 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.162460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.163796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:31.175931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:31.176959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:31.177814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 499/1001] 10.222.0.36 () {56 vars in 1105 bytes} [Wed Jun 22 08:43:31 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:31.178676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:31.220190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482840-1790-411f-8b63-5afba24f5d07 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.235433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:31.254322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.254984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.255265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.255538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.256237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:31.256539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.257908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.263986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 503/1002] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 22 08:43:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:31.264757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:31.279777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab5dba-7805-41a4-a5e1-5fec401d5bd2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.297797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:31.313577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.314271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.314555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.314831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.315608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] RBAC: Adding query filter params (interface=public, service_id=e2d92dbb3513483cb0bf7707e07b18bc, region_id=RegionOne) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:31.315927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.317261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.327503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 500/1003] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 22 08:43:31 2022] GET /identity/v3/endpoints?service_id=e2d92dbb3513483cb0bf7707e07b18bc&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:31.327503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:31.362805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f7dc-11cf-412d-8bb9-5146afa920bb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.397438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.398123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.398410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.398688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.399391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] RBAC: Adding query filter params (name=image) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:31.399698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.401052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.407393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 504/1004] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:31.408201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:31.424915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f173874-7000-4d01-887b-0bbaf68c13a5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.447358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:31.459842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acec3e1-6d42-4c71-8a92-f87363bf72f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.460504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec3e1-6d42-4c71-8a92-f87363bf72f3 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.460793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec3e1-6d42-4c71-8a92-f87363bf72f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.461075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acec3e1-6d42-4c71-8a92-f87363bf72f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.461812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acec3e1-6d42-4c71-8a92-f87363bf72f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.463202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acec3e1-6d42-4c71-8a92-f87363bf72f3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.506614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:31.510128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd129b-2e7f-4d72-9c1e-c87b2be0bb35 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.530023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 501/1005] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:43:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:31.530872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acec3e1-6d42-4c71-8a92-f87363bf72f3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:31.552083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf2802-54d9-4570-9408-dacf3bb2d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.552769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf2802-54d9-4570-9408-dacf3bb2d7ab None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.553055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf2802-54d9-4570-9408-dacf3bb2d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.553337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf2802-54d9-4570-9408-dacf3bb2d7ab None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.554043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf2802-54d9-4570-9408-dacf3bb2d7ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.555493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf2802-54d9-4570-9408-dacf3bb2d7ab None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.563252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 505/1006] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:43:31 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:43:31.664386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acec3e1-6d42-4c71-8a92-f87363bf72f3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:31.706665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4085e41-aad1-48f6-8b14-457048a4d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:31.707361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085e41-aad1-48f6-8b14-457048a4d49e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:31.707646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085e41-aad1-48f6-8b14-457048a4d49e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:31.707922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4085e41-aad1-48f6-8b14-457048a4d49e None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:31.708645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4085e41-aad1-48f6-8b14-457048a4d49e None admin] RBAC: Adding query filter params (type=image) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:31.708960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4085e41-aad1-48f6-8b14-457048a4d49e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:31.710420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4085e41-aad1-48f6-8b14-457048a4d49e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:31.716099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 502/1007] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:33.597426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49bf91-0375-4e2d-be95-3df854e228ea None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:33.597949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49bf91-0375-4e2d-be95-3df854e228ea None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:33.597949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49bf91-0375-4e2d-be95-3df854e228ea None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:33.599406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 506/1008] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:33.605249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc4a7-f833-46a8-b64a-a4ccf711bbd0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:33.605675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc4a7-f833-46a8-b64a-a4ccf711bbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:33.605848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc4a7-f833-46a8-b64a-a4ccf711bbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:33.623270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-533dc4a7-f833-46a8-b64a-a4ccf711bbd0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:33.624439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-533dc4a7-f833-46a8-b64a-a4ccf711bbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:33.669231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:33.680265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87e98b-c6f9-47de-abc3-326b24c1cb40 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:33.680554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87e98b-c6f9-47de-abc3-326b24c1cb40 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:33.680840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87e98b-c6f9-47de-abc3-326b24c1cb40 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:33.683054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 507/1009] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:33.688344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656cadf-f556-4201-9c73-d51322fcca97 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:33.688627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656cadf-f556-4201-9c73-d51322fcca97 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:33.688912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656cadf-f556-4201-9c73-d51322fcca97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:33.694379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 503/1010] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:33.706339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0656cadf-f556-4201-9c73-d51322fcca97 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:33.707533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0656cadf-f556-4201-9c73-d51322fcca97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:33.717922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc4a7-f833-46a8-b64a-a4ccf711bbd0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:33.782576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 508/1011] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:33.783805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e77c-8017-4321-8cf4-41077d319302 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:33.784099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e77c-8017-4321-8cf4-41077d319302 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:33.784381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e77c-8017-4321-8cf4-41077d319302 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:33.785655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 509/1012] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:33.790754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a789a-eeb2-423c-b1c8-26c5f6a93c4e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:33.791144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a789a-eeb2-423c-b1c8-26c5f6a93c4e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:33.791328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a789a-eeb2-423c-b1c8-26c5f6a93c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:33.809067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-167a789a-eeb2-423c-b1c8-26c5f6a93c4e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:33.810298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-167a789a-eeb2-423c-b1c8-26c5f6a93c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:33.831506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc4a7-f833-46a8-b64a-a4ccf711bbd0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:33.870313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291c058-c12b-4cda-b83d-8dddc35c18a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:33.871020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c058-c12b-4cda-b83d-8dddc35c18a3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:33.871301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c058-c12b-4cda-b83d-8dddc35c18a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:33.871571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c058-c12b-4cda-b83d-8dddc35c18a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:33.872751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291c058-c12b-4cda-b83d-8dddc35c18a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:33.874177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291c058-c12b-4cda-b83d-8dddc35c18a3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:33.875788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 504/1013] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:33.878936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291c058-c12b-4cda-b83d-8dddc35c18a3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:33.880238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 510/1014] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:33.881552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a789a-eeb2-423c-b1c8-26c5f6a93c4e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:33.900590 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:33.929314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:33.981767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a789a-eeb2-423c-b1c8-26c5f6a93c4e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:33.982284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291c058-c12b-4cda-b83d-8dddc35c18a3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:34.015646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3341a-fd17-4480-b42f-97053f2d5bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:34.015909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:34.016305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3341a-fd17-4480-b42f-97053f2d5bb5 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:34.016591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3341a-fd17-4480-b42f-97053f2d5bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:34.016715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:34.016875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3341a-fd17-4480-b42f-97053f2d5bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:34.017014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:34.017239 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:34.017576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3341a-fd17-4480-b42f-97053f2d5bb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:34.017884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:34.019019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3341a-fd17-4480-b42f-97053f2d5bb5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:34.019252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:34.031280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:34.032303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:34.033242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 505/1015] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:34.034090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:34.102437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 511/1016] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:43:33 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 08:43:34.103262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3341a-fd17-4480-b42f-97053f2d5bb5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:34.141556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f0a05-feb0-40f1-a346-6ba7cce8b6f9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:34.152101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:34.181172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44e6b-01f2-45aa-8c3c-f85ca75639e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:34.182539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44e6b-01f2-45aa-8c3c-f85ca75639e6 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:34.182856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44e6b-01f2-45aa-8c3c-f85ca75639e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:34.183161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44e6b-01f2-45aa-8c3c-f85ca75639e6 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:34.183976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef44e6b-01f2-45aa-8c3c-f85ca75639e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:34.185243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef44e6b-01f2-45aa-8c3c-f85ca75639e6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:34.201922 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:34.236231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3341a-fd17-4480-b42f-97053f2d5bb5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:34.272927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:34.273595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:34.273883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:34.274199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:34.275150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:34.275263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:34.277186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:34.282471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 512/1017] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:34.287866 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:34.297648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 506/1018] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:43:34 2022] POST /identity/v3/services => generated 242 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:34.403778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fb42-4230-44e2-bd9c-7245b98b83d6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:34.441285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:34.449099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10887a03-5247-441b-99f9-29bf89465c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:34.449861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887a03-5247-441b-99f9-29bf89465c22 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:34.450180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887a03-5247-441b-99f9-29bf89465c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:34.450455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887a03-5247-441b-99f9-29bf89465c22 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:34.453706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10887a03-5247-441b-99f9-29bf89465c22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:34.453706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10887a03-5247-441b-99f9-29bf89465c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:34.453706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10887a03-5247-441b-99f9-29bf89465c22 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:34.458545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 513/1019] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 22 08:43:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:34.465093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44e6b-01f2-45aa-8c3c-f85ca75639e6 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:34.580483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44e6b-01f2-45aa-8c3c-f85ca75639e6 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:34.617947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5c40c-d52e-4570-ba9c-cf777fcbdfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:34.618758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5c40c-d52e-4570-ba9c-cf777fcbdfb2 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:34.618942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5c40c-d52e-4570-ba9c-cf777fcbdfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:34.619261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5c40c-d52e-4570-ba9c-cf777fcbdfb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:34.620679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5c40c-d52e-4570-ba9c-cf777fcbdfb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:34.622398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5c40c-d52e-4570-ba9c-cf777fcbdfb2 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:34.710177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 507/1020] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:43:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:36.238338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b624d-a58a-416a-92a9-be9ad47bd3dd None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.238871 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b624d-a58a-416a-92a9-be9ad47bd3dd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.238952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b624d-a58a-416a-92a9-be9ad47bd3dd None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.240409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 514/1021] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:36.246109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413cc0-0f96-4efb-b66e-991b39367c35 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.246526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413cc0-0f96-4efb-b66e-991b39367c35 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.246732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a413cc0-0f96-4efb-b66e-991b39367c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.264386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0a413cc0-0f96-4efb-b66e-991b39367c35 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:36.265574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0a413cc0-0f96-4efb-b66e-991b39367c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:36.285003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:36.342000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 508/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:36.367666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b624d-a58a-416a-92a9-be9ad47bd3dd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:36.416694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d973b0-a170-47fa-8ca8-5e7bbcd1ad35 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.417560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d973b0-a170-47fa-8ca8-5e7bbcd1ad35 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.417850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d973b0-a170-47fa-8ca8-5e7bbcd1ad35 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.419264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 509/1023] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:36.424339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9a509-1563-40e5-a94a-32436cf3133e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.424625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9a509-1563-40e5-a94a-32436cf3133e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.424902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9a509-1563-40e5-a94a-32436cf3133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.442354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f1d9a509-1563-40e5-a94a-32436cf3133e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:36.443530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f1d9a509-1563-40e5-a94a-32436cf3133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:36.478190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b624d-a58a-416a-92a9-be9ad47bd3dd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:36.518180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 510/1024] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:36.518351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e82b49-1fab-4048-b2a8-bc5f3716e515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:36.518351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e82b49-1fab-4048-b2a8-bc5f3716e515 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.518351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e82b49-1fab-4048-b2a8-bc5f3716e515 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.518351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e82b49-1fab-4048-b2a8-bc5f3716e515 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.518648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e82b49-1fab-4048-b2a8-bc5f3716e515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:36.520058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e82b49-1fab-4048-b2a8-bc5f3716e515 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:36.526236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 515/1025] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:36.527453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9a509-1563-40e5-a94a-32436cf3133e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:36.538422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e82b49-1fab-4048-b2a8-bc5f3716e515 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:36.608629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:36.615767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:36.635892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9a509-1563-40e5-a94a-32436cf3133e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:36.653267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e82b49-1fab-4048-b2a8-bc5f3716e515 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:36.670794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62a1c1-8696-4d6f-8ba8-07b5759dd6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:36.672142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a1c1-8696-4d6f-8ba8-07b5759dd6be None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.672640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a1c1-8696-4d6f-8ba8-07b5759dd6be None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.673193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a1c1-8696-4d6f-8ba8-07b5759dd6be None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.674174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62a1c1-8696-4d6f-8ba8-07b5759dd6be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:36.675992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62a1c1-8696-4d6f-8ba8-07b5759dd6be None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:36.690904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:36.691698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.691981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.692266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] PATH_INFO: `/v3/services/image` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.692912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:36.694293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:36.705921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:36.706968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:36.707850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 516/1026] 10.222.0.36 () {56 vars in 1105 bytes} [Wed Jun 22 08:43:36 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:36.713073 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:36.782543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 511/1027] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:43:36 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:36.833142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bcb49-cd6a-4aae-91c6-f9d160dc5c00 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:36.864746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8a3c-2917-47ae-99b7-3266fa22e3dc None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.865094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8a3c-2917-47ae-99b7-3266fa22e3dc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.865308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8a3c-2917-47ae-99b7-3266fa22e3dc None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.865965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:36.866767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 512/1028] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:36.872915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8f32-2904-4827-b00c-daaaec683ea0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.873218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8f32-2904-4827-b00c-daaaec683ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.876798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b8f32-2904-4827-b00c-daaaec683ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.876927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:36.877530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:36.877813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:36.878118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:36.878844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:36.879153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:36.880530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:36.886829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 517/1029] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:36.892759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:36.896606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-529b8f32-2904-4827-b00c-daaaec683ea0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:36.897909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-529b8f32-2904-4827-b00c-daaaec683ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:36.978341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 513/1030] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:37.003436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b8f32-2904-4827-b00c-daaaec683ea0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:37.013180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f17262-721c-4ef4-92bc-5e55335f1bb9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:37.049477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:37.050088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:37.050376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:37.050653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:37.051361 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:37.051665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:37.053054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:37.058844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 518/1031] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:37.064714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:37.084848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:37.123566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b8f32-2904-4827-b00c-daaaec683ea0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:37.124116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:37.160912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6db08-b688-4b35-bddc-2e63093d14a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:37.161787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6db08-b688-4b35-bddc-2e63093d14a5 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:37.162178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6db08-b688-4b35-bddc-2e63093d14a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:37.162379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6db08-b688-4b35-bddc-2e63093d14a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:37.171799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20020837-5c02-4d27-b227-487c465d82e7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:37.173274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6db08-b688-4b35-bddc-2e63093d14a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-6cb6db08-b688-4b35-bddc-2e63093d14a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:37.181726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:37.183531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:37.186788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 514/1032] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 22 08:43:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:37.189803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6db08-b688-4b35-bddc-2e63093d14a5 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:37.211288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee405-f443-415b-920d-1930b618fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:37.211947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee405-f443-415b-920d-1930b618fefe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:37.212230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee405-f443-415b-920d-1930b618fefe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:37.212504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ee405-f443-415b-920d-1930b618fefe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:37.213290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee405-f443-415b-920d-1930b618fefe None admin] RBAC: Adding query filter params (interface=public, service_id=5e7cd974543040d497ba3eb99476fa08, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:37.213605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee405-f443-415b-920d-1930b618fefe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:37.215347 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ee405-f443-415b-920d-1930b618fefe None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:37.220647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 519/1033] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 22 08:43:37 2022] GET /identity/v3/endpoints?service_id=5e7cd974543040d497ba3eb99476fa08&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:37.225796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee405-f443-415b-920d-1930b618fefe None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:37.300537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6db08-b688-4b35-bddc-2e63093d14a5 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:37.329430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:37.332318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ee405-f443-415b-920d-1930b618fefe None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:37.338436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:37.339270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:37.339649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:37.340330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:37.340889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:37.341221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:37.342685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:37.351682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 515/1034] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 22 08:43:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:37.352082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:37.357988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:37.372051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58dba2-ea60-4d8d-9c7a-d2ca39ff2816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:37.372758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58dba2-ea60-4d8d-9c7a-d2ca39ff2816 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:37.373044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58dba2-ea60-4d8d-9c7a-d2ca39ff2816 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:37.373248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58dba2-ea60-4d8d-9c7a-d2ca39ff2816 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:37.374041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58dba2-ea60-4d8d-9c7a-d2ca39ff2816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:37.375417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58dba2-ea60-4d8d-9c7a-d2ca39ff2816 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:37.382731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 520/1035] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:43:37 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:43:37.473160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9239d5-b84a-4452-b0db-65106d634fe3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:37.510309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:37.511288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:37.511916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:37.512288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:37.523724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:37.525305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:37.550287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:37.551464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:37.552575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:37.552575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:37.552575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:37.552575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:37.552928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 516/1036] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:37.558692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58dba2-ea60-4d8d-9c7a-d2ca39ff2816 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:37.665283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58dba2-ea60-4d8d-9c7a-d2ca39ff2816 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:37.700990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:37.701883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:37.702369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:37.702784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:37.703666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:37.704118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:37.705606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:37.718555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 521/1037] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:37.723734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:37.767710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:37.832135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a8d4-2da1-4421-9271-e92bab29bcef None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:37.872208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:37.873359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:37.873854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:37.874348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:37.881804 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:37.883462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:37.898198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:37.899158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:37.900109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:37.906760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 517/1038] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:43:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:37.908301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:37.953732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:38.012322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df9911-16f3-4d6b-bbc5-2fa0b934e21d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:38.046043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:38.046731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:38.047011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:38.047284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:38.048118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:38.048425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:38.049833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:38.071496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 522/1039] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:43:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:38.073552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:38.172510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:38.176171 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06297e-118d-4e8d-bad0-3a0b38d38538 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:38.209192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11984025-6f19-4ad2-9300-c4bf3126b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:38.210274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984025-6f19-4ad2-9300-c4bf3126b02c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:38.210829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984025-6f19-4ad2-9300-c4bf3126b02c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:38.211558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11984025-6f19-4ad2-9300-c4bf3126b02c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:38.278322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11984025-6f19-4ad2-9300-c4bf3126b02c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:38.279743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11984025-6f19-4ad2-9300-c4bf3126b02c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:38.372930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:38.378215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 518/1040] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:43:38.383526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:38.487705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:38.490834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47e8e-6f69-426e-ad59-40b8e65da86c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:38.529496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:38.530342 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:38.530633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:38.530915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:38.541357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:38.543875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:38.562438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:38.563544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:38.573574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:38.573574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:38.573574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:38.573574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:38.573574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 523/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:38.573874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11984025-6f19-4ad2-9300-c4bf3126b02c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:38.675476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11984025-6f19-4ad2-9300-c4bf3126b02c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:38.710719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd1686-6fdd-4ed7-880f-155a1dcea906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:38.711652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd1686-6fdd-4ed7-880f-155a1dcea906 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:38.712120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd1686-6fdd-4ed7-880f-155a1dcea906 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:38.712571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd1686-6fdd-4ed7-880f-155a1dcea906 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:38.714241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd1686-6fdd-4ed7-880f-155a1dcea906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:38.714746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd1686-6fdd-4ed7-880f-155a1dcea906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:38.716311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd1686-6fdd-4ed7-880f-155a1dcea906 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:38.732980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 519/1042] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:38.734559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:38.846646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709006b-5c51-4fe7-aae7-d6bec94fc6b1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:38.884021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:38.884821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:38.885110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:38.885666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:38.892841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:38.894308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:38.908211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:38.909393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:38.910800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 524/1043] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:38.911702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de396-61e5-44e5-a7b3-9b88ce622294 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:38.911993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de396-61e5-44e5-a7b3-9b88ce622294 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:38.912277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de396-61e5-44e5-a7b3-9b88ce622294 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:38.913831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 520/1044] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:38.914939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:38.919331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a059bb-6edd-479a-a651-2b7817973722 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:38.919626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a059bb-6edd-479a-a651-2b7817973722 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:38.919910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a059bb-6edd-479a-a651-2b7817973722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:38.931658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:38.937168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-39a059bb-6edd-479a-a651-2b7817973722 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:38.938397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-39a059bb-6edd-479a-a651-2b7817973722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:39.000168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:39.012686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 521/1045] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:39.022364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203588e7-6df9-4d5d-a56d-7defac3bba99 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:39.036716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a059bb-6edd-479a-a651-2b7817973722 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.059667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:39.060328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.060610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.060886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.061683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:39.061997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:39.063466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:39.081488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 525/1046] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:39.083061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.144348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a059bb-6edd-479a-a651-2b7817973722 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:39.158476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:39.181904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172857cb-7958-4d69-b44a-f4351c98eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:39.183060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172857cb-7958-4d69-b44a-f4351c98eb48 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.183499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172857cb-7958-4d69-b44a-f4351c98eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.183776 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172857cb-7958-4d69-b44a-f4351c98eb48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.188138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b9b6b-c041-4022-95be-7c8f2c55f8a3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:39.194219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172857cb-7958-4d69-b44a-f4351c98eb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-172857cb-7958-4d69-b44a-f4351c98eb48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:39.201961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:39.203229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:39.204097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 522/1047] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:39.209191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172857cb-7958-4d69-b44a-f4351c98eb48 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.226109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:39.226764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.227050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.227324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.228154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] RBAC: Adding query filter params (role.id=05cf533ab06741a5899b787c8bb7ef55, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=4ade274e49f748ee8e3bec2a963cf1b2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:39.228467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:39.230629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:39.236115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 526/1048] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/role_assignments?user.id=4ade274e49f748ee8e3bec2a963cf1b2&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=05cf533ab06741a5899b787c8bb7ef55 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:39.265497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:39.321657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172857cb-7958-4d69-b44a-f4351c98eb48 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:39.358424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344d39c-56a3-4627-b3ca-2ac373153e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:39.359102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d39c-56a3-4627-b3ca-2ac373153e0c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.359385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d39c-56a3-4627-b3ca-2ac373153e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.359658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344d39c-56a3-4627-b3ca-2ac373153e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.360413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344d39c-56a3-4627-b3ca-2ac373153e0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:39.360718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344d39c-56a3-4627-b3ca-2ac373153e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:39.362082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344d39c-56a3-4627-b3ca-2ac373153e0c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:39.372332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 523/1049] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:39.378433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.476468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e48e-84d5-4e5f-93f0-349a36f0a0d8 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.477097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e48e-84d5-4e5f-93f0-349a36f0a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.477381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8e48e-84d5-4e5f-93f0-349a36f0a0d8 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.479517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 524/1050] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:39.484659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beac6d-892c-4110-ae68-703beca0b85c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.484942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beac6d-892c-4110-ae68-703beca0b85c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.485218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beac6d-892c-4110-ae68-703beca0b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.488782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41a659-a170-42fb-af0d-3946b7bdd30c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:39.503086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-07beac6d-892c-4110-ae68-703beca0b85c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:39.504444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-07beac6d-892c-4110-ae68-703beca0b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:39.523904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4994f3-f7de-4bd3-a908-d38163b3566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:39.525375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4994f3-f7de-4bd3-a908-d38163b3566e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.526019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4994f3-f7de-4bd3-a908-d38163b3566e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.526546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4994f3-f7de-4bd3-a908-d38163b3566e None admin] PATH_INFO: `/v3/users/06207b65180f4bf5aac7f81317b2189e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.530646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:39.546210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4994f3-f7de-4bd3-a908-d38163b3566e None admin] RBAC: Authorizing `identity:get_user(user_id=06207b65180f4bf5aac7f81317b2189e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:39.549635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4994f3-f7de-4bd3-a908-d38163b3566e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:39.550168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 527/1051] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/users/06207b65180f4bf5aac7f81317b2189e => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:39.555561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4994f3-f7de-4bd3-a908-d38163b3566e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.581237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 525/1052] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:39.604947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beac6d-892c-4110-ae68-703beca0b85c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.649192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:39.661476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4994f3-f7de-4bd3-a908-d38163b3566e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:39.697861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1f7b-d3cc-4856-a160-5faaf96d344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:39.698566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1f7b-d3cc-4856-a160-5faaf96d344c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.698845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1f7b-d3cc-4856-a160-5faaf96d344c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.699120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1f7b-d3cc-4856-a160-5faaf96d344c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.712385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beac6d-892c-4110-ae68-703beca0b85c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:39.749185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:39.749892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.750206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.750481 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] PATH_INFO: `/v3/services/image` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.751234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:39.752685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:39.765937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:39.767006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 08:43:39.767858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:39.768624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:39.768700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 526/1053] 10.222.0.36 () {56 vars in 1105 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:39.773887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.777425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1f7b-d3cc-4856-a160-5faaf96d344c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:39.782492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1f7b-d3cc-4856-a160-5faaf96d344c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:39.883772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c4a6f-8efb-4ba4-8156-12c952ecf867 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:39.894435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 528/1054] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:43:39.894609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:39.895868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1f7b-d3cc-4856-a160-5faaf96d344c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.922350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:39.923014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:39.923297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:39.923581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:39.924286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] RBAC: Adding query filter params (name=image) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:39.924593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:39.925953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:39.930940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 527/1055] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:39.937370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:39.996027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:40.005806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1f7b-d3cc-4856-a160-5faaf96d344c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:40.041636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d645-6d92-4af3-aa14-90c52e699a06 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:40.044569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19acf9-bbfd-4929-b31b-6ee1a76a6fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:40.045193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19acf9-bbfd-4929-b31b-6ee1a76a6fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:40.045480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19acf9-bbfd-4929-b31b-6ee1a76a6fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:40.045761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19acf9-bbfd-4929-b31b-6ee1a76a6fd3 None admin] PATH_INFO: `/v3/projects/3f55fce9f5b045dba17923a43dd80e9d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:40.047029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19acf9-bbfd-4929-b31b-6ee1a76a6fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=3f55fce9f5b045dba17923a43dd80e9d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:40.048501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19acf9-bbfd-4929-b31b-6ee1a76a6fd3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:40.050405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 529/1056] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/projects/3f55fce9f5b045dba17923a43dd80e9d => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:40.056317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19acf9-bbfd-4929-b31b-6ee1a76a6fd3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:40.077550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:40.078245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:40.078527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:40.078797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:40.079497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] RBAC: Adding query filter params (type=image) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:40.079806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:40.081130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:40.090088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 528/1057] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:40.092049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:40.128294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:40.164156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19acf9-bbfd-4929-b31b-6ee1a76a6fd3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:40.199339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9d588-5298-457f-ab9e-a55491e30699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:40.199532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ec6d0-5b83-4ab5-ad93-9bd4066acd81 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:40.199998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d588-5298-457f-ab9e-a55491e30699 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:40.200286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d588-5298-457f-ab9e-a55491e30699 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:40.200564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9d588-5298-457f-ab9e-a55491e30699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:40.201392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d588-5298-457f-ab9e-a55491e30699 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=3f55fce9f5b045dba17923a43dd80e9d, user.id=06207b65180f4bf5aac7f81317b2189e) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:40.201709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d588-5298-457f-ab9e-a55491e30699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:40.203161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9d588-5298-457f-ab9e-a55491e30699 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:40.209173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 530/1058] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:40 2022] GET /identity/v3/role_assignments?user.id=06207b65180f4bf5aac7f81317b2189e&scope.project.id=3f55fce9f5b045dba17923a43dd80e9d&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:40.236511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86be36-a7df-4bca-8e85-b0754ce29b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:40.237553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86be36-a7df-4bca-8e85-b0754ce29b5f None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:40.238019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86be36-a7df-4bca-8e85-b0754ce29b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:40.238525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86be36-a7df-4bca-8e85-b0754ce29b5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:40.239477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86be36-a7df-4bca-8e85-b0754ce29b5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:40.241054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86be36-a7df-4bca-8e85-b0754ce29b5f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:40.336917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 529/1059] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:43:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:41.304517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a038cd-8a31-415d-a4de-dda196e7e0a2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:41.305055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a038cd-8a31-415d-a4de-dda196e7e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:41.305055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a038cd-8a31-415d-a4de-dda196e7e0a2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:41.306870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 531/1060] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:41.313358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04b9e-6a1a-4b6f-b888-77d6e1d526c4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:41.313837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04b9e-6a1a-4b6f-b888-77d6e1d526c4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:41.313911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04b9e-6a1a-4b6f-b888-77d6e1d526c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:41.331180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-04c04b9e-6a1a-4b6f-b888-77d6e1d526c4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:41.332372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-04c04b9e-6a1a-4b6f-b888-77d6e1d526c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:41.407897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 530/1061] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:41.430269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a038cd-8a31-415d-a4de-dda196e7e0a2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:41.459836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:41.539216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a038cd-8a31-415d-a4de-dda196e7e0a2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:41.575336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d7f2-f44c-4bae-9b84-776a7dc6ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:41.576067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d7f2-f44c-4bae-9b84-776a7dc6ef33 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:41.576351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d7f2-f44c-4bae-9b84-776a7dc6ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:41.576629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2d7f2-f44c-4bae-9b84-776a7dc6ef33 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:41.587156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2d7f2-f44c-4bae-9b84-776a7dc6ef33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a5b2d7f2-f44c-4bae-9b84-776a7dc6ef33 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:41.595533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:41.596464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:41.602715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 532/1062] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 22 08:43:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:41.605063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c04b9e-6a1a-4b6f-b888-77d6e1d526c4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:41.634220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:41.717905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c04b9e-6a1a-4b6f-b888-77d6e1d526c4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:41.754020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:41.754715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:41.754997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:41.755268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:41.756001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:41.756301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:41.757635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:41.769994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 531/1063] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 22 08:43:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:41.771716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d7f2-f44c-4bae-9b84-776a7dc6ef33 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:41.862683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:41.877869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2d7f2-f44c-4bae-9b84-776a7dc6ef33 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:41.913643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:41.914447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:41.914730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:41.915006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:41.925236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:41.926704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:41.944471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:41.945407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:41.946324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:41.946324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:41.946324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:41.946324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:41.950505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 533/1064] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:41.952031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.031599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:42.053552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23554bf-a11a-4a6c-a41d-439c1ce7a70b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:42.090282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d810490-41a3-497d-b82e-ab6c6e2a15ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:42.090883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d810490-41a3-497d-b82e-ab6c6e2a15ae None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.091172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d810490-41a3-497d-b82e-ab6c6e2a15ae None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.091448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d810490-41a3-497d-b82e-ab6c6e2a15ae None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.092178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d810490-41a3-497d-b82e-ab6c6e2a15ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:42.092487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d810490-41a3-497d-b82e-ab6c6e2a15ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:42.093841 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d810490-41a3-497d-b82e-ab6c6e2a15ae None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:42.111181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 532/1065] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:42.113004 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.217868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9c943-4d75-46ba-ac4f-7ec8584413ea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:42.240325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59ef94-0992-462f-a4bb-a4571fc21bfc None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.240651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59ef94-0992-462f-a4bb-a4571fc21bfc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.240886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59ef94-0992-462f-a4bb-a4571fc21bfc None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.242418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 533/1066] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:42.248119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cbff-92d2-4a2d-9555-76f4f1c0d34e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.248421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cbff-92d2-4a2d-9555-76f4f1c0d34e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.248679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cbff-92d2-4a2d-9555-76f4f1c0d34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.254511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:42.255314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.255602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.255882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.264385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:42.265834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:42.267206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ea07cbff-92d2-4a2d-9555-76f4f1c0d34e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:42.267646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:42.268388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ea07cbff-92d2-4a2d-9555-76f4f1c0d34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:42.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:42.283731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:42.284668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 534/1067] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:42.290565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.345121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 534/1068] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:42.368379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07cbff-92d2-4a2d-9555-76f4f1c0d34e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.397678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645dd5d-e85b-4e6d-9f64-189a3a4f804c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:42.434809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:42.435449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e683f4-9e15-48fe-9c28-b0c2d496b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:42.436114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e683f4-9e15-48fe-9c28-b0c2d496b2da None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.436394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e683f4-9e15-48fe-9c28-b0c2d496b2da None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.436666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e683f4-9e15-48fe-9c28-b0c2d496b2da None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.437495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e683f4-9e15-48fe-9c28-b0c2d496b2da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:42.437805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e683f4-9e15-48fe-9c28-b0c2d496b2da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:42.443486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e683f4-9e15-48fe-9c28-b0c2d496b2da None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:42.461295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 535/1069] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:42.462619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d71ec-f1f1-4745-8d60-8d0a013c26be None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.462910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d71ec-f1f1-4745-8d60-8d0a013c26be None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.463914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d71ec-f1f1-4745-8d60-8d0a013c26be None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.465492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 536/1070] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:42.467908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d71ec-f1f1-4745-8d60-8d0a013c26be None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.469188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07cbff-92d2-4a2d-9555-76f4f1c0d34e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:42.503845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e6b50-7cca-4a3b-b615-a29a370fbbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:42.504640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6b50-7cca-4a3b-b615-a29a370fbbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.504924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6b50-7cca-4a3b-b615-a29a370fbbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.505202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6b50-7cca-4a3b-b615-a29a370fbbe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.515736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e6b50-7cca-4a3b-b615-a29a370fbbe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-213e6b50-7cca-4a3b-b615-a29a370fbbe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:42.523412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:42.524331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 535/1071] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:42.526274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf9d2c-a131-462d-8986-32de273ed9c8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.527030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf9d2c-a131-462d-8986-32de273ed9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.527030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf9d2c-a131-462d-8986-32de273ed9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.530338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:42.545338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-51cf9d2c-a131-462d-8986-32de273ed9c8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:42.546556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-51cf9d2c-a131-462d-8986-32de273ed9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:42.571133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d71ec-f1f1-4745-8d60-8d0a013c26be None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:42.605794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:42.606606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.606890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.607164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.612655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 536/1072] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:42.613486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf9d2c-a131-462d-8986-32de273ed9c8 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.618953 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:42.621129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:42.644613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:42.645651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:42.646609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:42.646609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:42.646609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:42.646609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:42.650111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 537/1073] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:42.651040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.673872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:42.715267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf9d2c-a131-462d-8986-32de273ed9c8 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:42.749751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:42.750452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.750740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.751022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.751123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee45f65-04f8-48c1-82a3-ae1c8735dacb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:42.751770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:42.752080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:42.753437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:42.759857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:42.762074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 537/1074] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:42.762878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.785014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd949c-cafe-4b7c-b525-20144f9bd702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:42.785716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd949c-cafe-4b7c-b525-20144f9bd702 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.786082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd949c-cafe-4b7c-b525-20144f9bd702 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.786479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd949c-cafe-4b7c-b525-20144f9bd702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.860264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd949c-cafe-4b7c-b525-20144f9bd702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:42.861626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd949c-cafe-4b7c-b525-20144f9bd702 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:42.864754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dddfd5-4b34-4cac-9f7b-2d56a46fcb70 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:42.883940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:42.897823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:42.898504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:42.898785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:42.899059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:42.899767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:42.900072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:42.902037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:42.921197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 538/1075] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:42.922021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.968052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 538/1076] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:43:42.968052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd949c-cafe-4b7c-b525-20144f9bd702 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:42.976248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:43.019193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031e5cf-a698-42db-a787-125620349d2f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:43.055313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84204579-9c34-44ab-8544-041906cd2596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:43.056186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204579-9c34-44ab-8544-041906cd2596 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:43.056469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204579-9c34-44ab-8544-041906cd2596 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:43.056746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204579-9c34-44ab-8544-041906cd2596 None admin] PATH_INFO: `/v3/users/06207b65180f4bf5aac7f81317b2189e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:43.058369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84204579-9c34-44ab-8544-041906cd2596 None admin] RBAC: Authorizing `identity:get_user(user_id=06207b65180f4bf5aac7f81317b2189e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:43.059852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84204579-9c34-44ab-8544-041906cd2596 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:43.061662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 539/1077] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/users/06207b65180f4bf5aac7f81317b2189e => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:43.062271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84204579-9c34-44ab-8544-041906cd2596 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:43.067339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd949c-cafe-4b7c-b525-20144f9bd702 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:43.100764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:43.101548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:43.101832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:43.102130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:43.109552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:43.111055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:43.113347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:43.124801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:43.128372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 539/1078] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:43.130508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:43.168514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84204579-9c34-44ab-8544-041906cd2596 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:43.193948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:43.202241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481107-f894-4576-b702-d1540e097e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:43.206943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481107-f894-4576-b702-d1540e097e3d None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:43.206943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481107-f894-4576-b702-d1540e097e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:43.206943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39481107-f894-4576-b702-d1540e097e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:43.214237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39481107-f894-4576-b702-d1540e097e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:43.215662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39481107-f894-4576-b702-d1540e097e3d None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:43.228077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fbeb3-4d99-459a-b194-ce0038570251 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-39481107-f894-4576-b702-d1540e097e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:43.232916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:43.233796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:43.234902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:43.234902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:43.234902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:43.234902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:43.234902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 540/1079] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:43.234902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481107-f894-4576-b702-d1540e097e3d None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:43.262784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4ed49-0a8a-4549-9484-f8b057d28062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:43.263636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4ed49-0a8a-4549-9484-f8b057d28062 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:43.263921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4ed49-0a8a-4549-9484-f8b057d28062 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:43.264198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4ed49-0a8a-4549-9484-f8b057d28062 None admin] PATH_INFO: `/v3/projects/3f55fce9f5b045dba17923a43dd80e9d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:43.265362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4ed49-0a8a-4549-9484-f8b057d28062 None admin] RBAC: Authorizing `identity:get_project(project_id=3f55fce9f5b045dba17923a43dd80e9d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:43.266803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4ed49-0a8a-4549-9484-f8b057d28062 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:43.268483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 540/1080] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:43:43 2022] GET /identity/v3/projects/3f55fce9f5b045dba17923a43dd80e9d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:43.268483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4ed49-0a8a-4549-9484-f8b057d28062 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:43.333508 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:43.336643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39481107-f894-4576-b702-d1540e097e3d None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:43.366816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4ed49-0a8a-4549-9484-f8b057d28062 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:43.369708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:43.370394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:43.370680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:43.370959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:43.371758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:43.372064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:43.373468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:43.385671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 541/1081] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:43.386731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:43.403102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:43.403862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:43.404210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:43.404558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:43.405280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:43.405591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:43.406976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:43.409537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:43.419278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 541/1082] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:43.420038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:43.508076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afab047-f2f0-41e1-98fe-b6a845576f45 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:43.534864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980291e5-b2a4-4c72-9c00-9f2ea1fd2539 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:43.547826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341aac80-e67b-47d3-9630-7cd567d34315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:43.548717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aac80-e67b-47d3-9630-7cd567d34315 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:43.549002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aac80-e67b-47d3-9630-7cd567d34315 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:43.549278 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341aac80-e67b-47d3-9630-7cd567d34315 None admin] PATH_INFO: `/v3/projects/3f55fce9f5b045dba17923a43dd80e9d/users/06207b65180f4bf5aac7f81317b2189e/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:43.551534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aac80-e67b-47d3-9630-7cd567d34315 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f55fce9f5b045dba17923a43dd80e9d, user_id=06207b65180f4bf5aac7f81317b2189e, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:43.552975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341aac80-e67b-47d3-9630-7cd567d34315 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:43.574537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d963134-97db-4fd7-afc9-e839fef6d991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:43.575501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963134-97db-4fd7-afc9-e839fef6d991 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:43.575782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963134-97db-4fd7-afc9-e839fef6d991 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:43.576057 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963134-97db-4fd7-afc9-e839fef6d991 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/4ade274e49f748ee8e3bec2a963cf1b2/roles/05cf533ab06741a5899b787c8bb7ef55` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:43.578326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d963134-97db-4fd7-afc9-e839fef6d991 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=4ade274e49f748ee8e3bec2a963cf1b2, role_id=05cf533ab06741a5899b787c8bb7ef55)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:43.579785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d963134-97db-4fd7-afc9-e839fef6d991 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:43.630595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 542/1083] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:43:43 2022] PUT /identity/v3/projects/3f55fce9f5b045dba17923a43dd80e9d/users/06207b65180f4bf5aac7f81317b2189e/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:43:43.691034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 542/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:43:43 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/4ade274e49f748ee8e3bec2a963cf1b2/roles/05cf533ab06741a5899b787c8bb7ef55 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:43:45.672462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b16c-6d46-4e4a-a1c0-75d76fac8bdc None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:45.672462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b16c-6d46-4e4a-a1c0-75d76fac8bdc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:45.672462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746b16c-6d46-4e4a-a1c0-75d76fac8bdc None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:45.673286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 543/1085] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:45.677638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044dfa-abbb-4eac-94e7-a606c93ce2c7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:45.678092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044dfa-abbb-4eac-94e7-a606c93ce2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:45.678234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044dfa-abbb-4eac-94e7-a606c93ce2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:45.695807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c7044dfa-abbb-4eac-94e7-a606c93ce2c7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:45.696992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c7044dfa-abbb-4eac-94e7-a606c93ce2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:45.718659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794911c6-7615-494e-ba07-30d6e2993100 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:45.718941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794911c6-7615-494e-ba07-30d6e2993100 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:45.719216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794911c6-7615-494e-ba07-30d6e2993100 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:45.720578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 544/1086] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:43:45.725352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a75958-5e9b-4de1-8b89-294eb277f778 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:45.725636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a75958-5e9b-4de1-8b89-294eb277f778 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:45.725916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a75958-5e9b-4de1-8b89-294eb277f778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:45.743146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-43a75958-5e9b-4de1-8b89-294eb277f778 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:45.745709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-43a75958-5e9b-4de1-8b89-294eb277f778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:45.750086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:45.765838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:45.767804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 543/1087] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:45.794328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7044dfa-abbb-4eac-94e7-a606c93ce2c7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:45.846104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 545/1088] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:43:45.871305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a75958-5e9b-4de1-8b89-294eb277f778 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:45.920035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7044dfa-abbb-4eac-94e7-a606c93ce2c7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:45.957542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87765611-a4c8-40d8-a207-29dce6169844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:45.958364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87765611-a4c8-40d8-a207-29dce6169844 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:45.958663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87765611-a4c8-40d8-a207-29dce6169844 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:45.958946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87765611-a4c8-40d8-a207-29dce6169844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:45.969785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87765611-a4c8-40d8-a207-29dce6169844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:45.976854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a75958-5e9b-4de1-8b89-294eb277f778 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-87765611-a4c8-40d8-a207-29dce6169844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:45.977489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:45.978511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:45.979495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 544/1089] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:43:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:45.984894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87765611-a4c8-40d8-a207-29dce6169844 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.017295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e506f-e886-486e-81c8-8c2c64f00cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.018136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e506f-e886-486e-81c8-8c2c64f00cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.018418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e506f-e886-486e-81c8-8c2c64f00cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.018701 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e506f-e886-486e-81c8-8c2c64f00cd8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.028895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e506f-e886-486e-81c8-8c2c64f00cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:43:46.034663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-012e506f-e886-486e-81c8-8c2c64f00cd8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:43:46.037107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:46.038084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:46.038946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 546/1090] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 22 08:43:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:46.044537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e506f-e886-486e-81c8-8c2c64f00cd8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.059498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:46.091354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87765611-a4c8-40d8-a207-29dce6169844 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.126369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.127192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.127480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.127755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.128506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:46.128809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.130199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.139748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 545/1091] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:46.145447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.158277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e506f-e886-486e-81c8-8c2c64f00cd8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.192512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.193173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.193448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.193857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.194517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:46.194827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.196182 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.204574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 547/1092] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:46.210277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.248989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cab01-32ed-41ea-9545-c2a839053386 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.258095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:46.286561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737ea4a-5a12-49bf-b5a3-bc81582f1bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.287435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737ea4a-5a12-49bf-b5a3-bc81582f1bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.287943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737ea4a-5a12-49bf-b5a3-bc81582f1bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.288115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737ea4a-5a12-49bf-b5a3-bc81582f1bd2 None admin] PATH_INFO: `/v3/users/06207b65180f4bf5aac7f81317b2189e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.289550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737ea4a-5a12-49bf-b5a3-bc81582f1bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=06207b65180f4bf5aac7f81317b2189e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.290265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:46.291301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737ea4a-5a12-49bf-b5a3-bc81582f1bd2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.293203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 546/1093] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/users/06207b65180f4bf5aac7f81317b2189e => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:46.298873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737ea4a-5a12-49bf-b5a3-bc81582f1bd2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.328316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70792fb-e09a-43eb-9ec5-d3ac11563ffb None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.372410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.373334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.373623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.373901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.385916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.387706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.403784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737ea4a-5a12-49bf-b5a3-bc81582f1bd2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:46.407403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:46.408318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:46.409237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:46.409237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:46.409237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:46.409237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:46.409237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 548/1094] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:46.414519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.438278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d078f0f-5485-449f-8134-e7971b0fe0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.438934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d078f0f-5485-449f-8134-e7971b0fe0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.439216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d078f0f-5485-449f-8134-e7971b0fe0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.439490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d078f0f-5485-449f-8134-e7971b0fe0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.488655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:46.512499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d078f0f-5485-449f-8134-e7971b0fe0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.513941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d078f0f-5485-449f-8134-e7971b0fe0c1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.523919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feeb1aa-6350-436d-aac5-4211b1760c26 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.548990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:46.559871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.560530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.560813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.561083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.562213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:46.562213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.563431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.575600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 549/1095] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:46.581675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.616373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 547/1096] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 08:43:46.622903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d078f0f-5485-449f-8134-e7971b0fe0c1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.689792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1495a4-9cd0-4a8e-ac3c-e8050131de3a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.700651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:46.724682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d078f0f-5485-449f-8134-e7971b0fe0c1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.725082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.725879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.726219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.726493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.733772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.735245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:43:46.750251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:46.751249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:43:46.752204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 550/1097] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:43:46.757517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.760741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aeed7-825f-4c5f-b39f-50b252b00af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.762233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aeed7-825f-4c5f-b39f-50b252b00af9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.762518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aeed7-825f-4c5f-b39f-50b252b00af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.762790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817aeed7-825f-4c5f-b39f-50b252b00af9 None admin] PATH_INFO: `/v3/projects/3f55fce9f5b045dba17923a43dd80e9d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.763971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aeed7-825f-4c5f-b39f-50b252b00af9 None admin] RBAC: Authorizing `identity:get_project(project_id=3f55fce9f5b045dba17923a43dd80e9d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.765416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817aeed7-825f-4c5f-b39f-50b252b00af9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.767265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 548/1098] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/projects/3f55fce9f5b045dba17923a43dd80e9d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:46.772908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aeed7-825f-4c5f-b39f-50b252b00af9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:46.804478 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:46.861978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe511e-3e54-4992-b891-cb406ad67489 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.874917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817aeed7-825f-4c5f-b39f-50b252b00af9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:46.897836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.898544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.898829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.899108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.899942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:46.900253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.902226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.910007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:46.910689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:46.910974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:46.911248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:46.912069 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=3f55fce9f5b045dba17923a43dd80e9d, user.id=06207b65180f4bf5aac7f81317b2189e) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:46.912382 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:46.913790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:46.920014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 551/1099] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:46.924555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 549/1100] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/role_assignments?user.id=06207b65180f4bf5aac7f81317b2189e&scope.project.id=3f55fce9f5b045dba17923a43dd80e9d&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:46.926177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:47.038681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950a24-dfc0-49ef-b19b-a472a292ab54 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:47.040221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:47.076077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54594b1c-c4c6-4415-881c-dfc1bf35303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:47.077122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54594b1c-c4c6-4415-881c-dfc1bf35303c None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:47.077122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54594b1c-c4c6-4415-881c-dfc1bf35303c None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:47.077309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54594b1c-c4c6-4415-881c-dfc1bf35303c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:47.144979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54594b1c-c4c6-4415-881c-dfc1bf35303c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:47.146442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54594b1c-c4c6-4415-881c-dfc1bf35303c None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:47.244980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 552/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:43:47.250731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:47.263534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:47.352467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1cbc8-6a06-4ff2-b366-ad0d05e94e71 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:47.385904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:47.387170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:47.387458 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:47.387736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:47.398230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:47.399660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:43:47.416576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:47.417625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:47.418749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:43:47.418749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:43:47.418749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:43:47.418749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:47.418749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 550/1102] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:47.423455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54594b1c-c4c6-4415-881c-dfc1bf35303c None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:47.425655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:47.521803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54594b1c-c4c6-4415-881c-dfc1bf35303c None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:47.554359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:47.555026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:47.555315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:47.555596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:47.556323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:47.557140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:47.558731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:47.575386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 553/1103] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:47.576411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:47.635663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:47.677843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dabf6b-6e89-4ae6-a8f2-20baf1b16a42 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:47.720676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:47.721476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:47.721766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:47.722045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:47.728881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:47.730594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:43:47.745261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:43:47.746272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:43:47.747208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 551/1104] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:43:47.752252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:47.813919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:47.854539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df07d4-b962-4613-8ee2-5e68cecbd7c8 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:47.888231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf01d3f-cba6-4dc5-8062-bdc217d55ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:47.888822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf01d3f-cba6-4dc5-8062-bdc217d55ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:47.889195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf01d3f-cba6-4dc5-8062-bdc217d55ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:47.889476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf01d3f-cba6-4dc5-8062-bdc217d55ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:47.890293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf01d3f-cba6-4dc5-8062-bdc217d55ef8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:47.890606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf01d3f-cba6-4dc5-8062-bdc217d55ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:47.892012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf01d3f-cba6-4dc5-8062-bdc217d55ef8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:47.905280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 554/1105] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:47.911125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:48.008715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71bbea-fc27-47d2-b4fe-3971ee5e9e54 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:48.030037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:48.044363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef6ed2-6a93-4719-b8d7-679012bf38c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:48.045038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6ed2-6a93-4719-b8d7-679012bf38c2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:48.045320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6ed2-6a93-4719-b8d7-679012bf38c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:48.045596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef6ed2-6a93-4719-b8d7-679012bf38c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:48.046486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef6ed2-6a93-4719-b8d7-679012bf38c2 None admin] RBAC: Adding query filter params (role.id=05cf533ab06741a5899b787c8bb7ef55, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=4ade274e49f748ee8e3bec2a963cf1b2) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:48.046801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef6ed2-6a93-4719-b8d7-679012bf38c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:48.048301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef6ed2-6a93-4719-b8d7-679012bf38c2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:48.054809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 552/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:47 2022] GET /identity/v3/role_assignments?user.id=4ade274e49f748ee8e3bec2a963cf1b2&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=05cf533ab06741a5899b787c8bb7ef55 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:48.989063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254581-44e7-4527-bf69-94c664c0a955 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:48.989578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254581-44e7-4527-bf69-94c664c0a955 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:48.989692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f254581-44e7-4527-bf69-94c664c0a955 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:48.991026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 555/1107] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:48.996408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368b220-4d54-4900-8cc0-a4393d64e463 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:48.996824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368b220-4d54-4900-8cc0-a4393d64e463 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:48.996967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368b220-4d54-4900-8cc0-a4393d64e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:49.014371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5368b220-4d54-4900-8cc0-a4393d64e463 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:49.015557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5368b220-4d54-4900-8cc0-a4393d64e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:49.080453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 553/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:49.105915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f254581-44e7-4527-bf69-94c664c0a955 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:49.206447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f254581-44e7-4527-bf69-94c664c0a955 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:49.229407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:49.240465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ded93-5c7e-4dcd-943c-345b93117bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:49.246158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ded93-5c7e-4dcd-943c-345b93117bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:49.246158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ded93-5c7e-4dcd-943c-345b93117bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:49.246158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ded93-5c7e-4dcd-943c-345b93117bb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:49.246158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ded93-5c7e-4dcd-943c-345b93117bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:49.246158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ded93-5c7e-4dcd-943c-345b93117bb0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:49.246587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 556/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:43:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:49.252243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368b220-4d54-4900-8cc0-a4393d64e463 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:49.346692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368b220-4d54-4900-8cc0-a4393d64e463 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:49.360598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:49.379547 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb085ff7-d636-4d21-b738-0c3c9a650dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:49.380194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085ff7-d636-4d21-b738-0c3c9a650dd7 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:49.380473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085ff7-d636-4d21-b738-0c3c9a650dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:49.380743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085ff7-d636-4d21-b738-0c3c9a650dd7 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:49.381446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb085ff7-d636-4d21-b738-0c3c9a650dd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:49.382873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb085ff7-d636-4d21-b738-0c3c9a650dd7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:49.488648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 554/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:43:49 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:43:51.544545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e5ec-27f3-4aee-b51b-2b27eea904f5 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:51.545175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e5ec-27f3-4aee-b51b-2b27eea904f5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:51.545175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e5ec-27f3-4aee-b51b-2b27eea904f5 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:51.546485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 557/1111] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:51.551580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19c1b-1ed3-46b3-8d7b-16536d8c00e5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:51.551982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19c1b-1ed3-46b3-8d7b-16536d8c00e5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:51.552135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b19c1b-1ed3-46b3-8d7b-16536d8c00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:51.568381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-92b19c1b-1ed3-46b3-8d7b-16536d8c00e5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:51.569546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-92b19c1b-1ed3-46b3-8d7b-16536d8c00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:51.634600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 555/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:51.658519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e5ec-27f3-4aee-b51b-2b27eea904f5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:51.756898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e5ec-27f3-4aee-b51b-2b27eea904f5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:51.789256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fbd72-abc0-43cc-b98d-6827ed602662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:51.790109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fbd72-abc0-43cc-b98d-6827ed602662 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:51.790391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fbd72-abc0-43cc-b98d-6827ed602662 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:51.790661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fbd72-abc0-43cc-b98d-6827ed602662 None admin] PATH_INFO: `/v3/roles/23dcaf1f585d4a03a6101a69a6bdd9f1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:51.792788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fbd72-abc0-43cc-b98d-6827ed602662 None admin] RBAC: Authorizing `identity:get_role(role_id=23dcaf1f585d4a03a6101a69a6bdd9f1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:51.794235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fbd72-abc0-43cc-b98d-6827ed602662 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:51.795640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 558/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:51 2022] GET /identity/v3/roles/23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:51.802853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b19c1b-1ed3-46b3-8d7b-16536d8c00e5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:51.900689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:51.903572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b19c1b-1ed3-46b3-8d7b-16536d8c00e5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:51.936612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1970a-b4c7-4b49-bcb2-df2ad68ddd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:51.937461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1970a-b4c7-4b49-bcb2-df2ad68ddd15 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:51.937743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1970a-b4c7-4b49-bcb2-df2ad68ddd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:51.938017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1970a-b4c7-4b49-bcb2-df2ad68ddd15 None admin] PATH_INFO: `/v3/users/f803e78b821241c1b479fe3fec5ad07d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:51.951895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1970a-b4c7-4b49-bcb2-df2ad68ddd15 None admin] RBAC: Authorizing `identity:get_user(user_id=f803e78b821241c1b479fe3fec5ad07d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:51.953318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1970a-b4c7-4b49-bcb2-df2ad68ddd15 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:51.954992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 556/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:51 2022] GET /identity/v3/users/f803e78b821241c1b479fe3fec5ad07d => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:51.960765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fbd72-abc0-43cc-b98d-6827ed602662 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:52.017929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:52.057653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fbd72-abc0-43cc-b98d-6827ed602662 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:52.090305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d0ab6-07a8-4efa-970a-6e78bc160fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:52.090939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d0ab6-07a8-4efa-970a-6e78bc160fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:52.091221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d0ab6-07a8-4efa-970a-6e78bc160fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:52.091495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d0ab6-07a8-4efa-970a-6e78bc160fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:52.156198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d0ab6-07a8-4efa-970a-6e78bc160fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:52.157601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d0ab6-07a8-4efa-970a-6e78bc160fd9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:52.211381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:52.252724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 559/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:43:52.258508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1970a-b4c7-4b49-bcb2-df2ad68ddd15 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:52.353712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1970a-b4c7-4b49-bcb2-df2ad68ddd15 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:52.386448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d5201-ae2e-46a9-9444-82eb4e02576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:52.387279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d5201-ae2e-46a9-9444-82eb4e02576f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:52.387559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d5201-ae2e-46a9-9444-82eb4e02576f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:52.387830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d5201-ae2e-46a9-9444-82eb4e02576f None admin] PATH_INFO: `/v3/projects/3f55fce9f5b045dba17923a43dd80e9d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:52.388976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d5201-ae2e-46a9-9444-82eb4e02576f None admin] RBAC: Authorizing `identity:get_project(project_id=3f55fce9f5b045dba17923a43dd80e9d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:52.390403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d5201-ae2e-46a9-9444-82eb4e02576f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:52.392211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 557/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:43:52 2022] GET /identity/v3/projects/3f55fce9f5b045dba17923a43dd80e9d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:52.398190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d0ab6-07a8-4efa-970a-6e78bc160fd9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:52.493175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d0ab6-07a8-4efa-970a-6e78bc160fd9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:52.526631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93c7e-3ded-4f60-a3d1-61c8980155f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:52.527266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93c7e-3ded-4f60-a3d1-61c8980155f9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:52.527552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93c7e-3ded-4f60-a3d1-61c8980155f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:52.527829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93c7e-3ded-4f60-a3d1-61c8980155f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:52.528649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93c7e-3ded-4f60-a3d1-61c8980155f9 None admin] RBAC: Adding query filter params (role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=3f55fce9f5b045dba17923a43dd80e9d, user.id=f803e78b821241c1b479fe3fec5ad07d) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:52.528962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93c7e-3ded-4f60-a3d1-61c8980155f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:52.530386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93c7e-3ded-4f60-a3d1-61c8980155f9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:52.535677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 560/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:52 2022] GET /identity/v3/role_assignments?user.id=f803e78b821241c1b479fe3fec5ad07d&scope.project.id=3f55fce9f5b045dba17923a43dd80e9d&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:54.532204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898d9e-1c01-43b6-973e-ea05849f048d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:54.532760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898d9e-1c01-43b6-973e-ea05849f048d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:54.532760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b898d9e-1c01-43b6-973e-ea05849f048d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:54.534122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 558/1118] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:54.539238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6062-3773-489d-8821-662a3469dab4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:54.539623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6062-3773-489d-8821-662a3469dab4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:54.539795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a6062-3773-489d-8821-662a3469dab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:54.556553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fc9a6062-3773-489d-8821-662a3469dab4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:54.557740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fc9a6062-3773-489d-8821-662a3469dab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:54.574416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:54.623601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 561/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:54.647117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b898d9e-1c01-43b6-973e-ea05849f048d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:54.673852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:54.745614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b898d9e-1c01-43b6-973e-ea05849f048d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:54.780394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da2638-d6e5-42c5-9558-c22696424d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:54.781230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2638-d6e5-42c5-9558-c22696424d74 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:54.781512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2638-d6e5-42c5-9558-c22696424d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:54.781788 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2638-d6e5-42c5-9558-c22696424d74 None admin] PATH_INFO: `/v3/roles/23dcaf1f585d4a03a6101a69a6bdd9f1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:54.783334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da2638-d6e5-42c5-9558-c22696424d74 None admin] RBAC: Authorizing `identity:get_role(role_id=23dcaf1f585d4a03a6101a69a6bdd9f1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:54.784637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da2638-d6e5-42c5-9558-c22696424d74 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:54.785988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 559/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:54 2022] GET /identity/v3/roles/23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:54.791995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a6062-3773-489d-8821-662a3469dab4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:54.888593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a6062-3773-489d-8821-662a3469dab4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:54.920618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3537-da27-40ac-a6ab-6f6654a15a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:54.921474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3537-da27-40ac-a6ab-6f6654a15a66 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:54.921759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3537-da27-40ac-a6ab-6f6654a15a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:54.922034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3537-da27-40ac-a6ab-6f6654a15a66 None admin] PATH_INFO: `/v3/users/f803e78b821241c1b479fe3fec5ad07d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:54.923231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3537-da27-40ac-a6ab-6f6654a15a66 None admin] RBAC: Authorizing `identity:get_user(user_id=f803e78b821241c1b479fe3fec5ad07d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:54.924659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3537-da27-40ac-a6ab-6f6654a15a66 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:54.926312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 562/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:54 2022] GET /identity/v3/users/f803e78b821241c1b479fe3fec5ad07d => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:54.932776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da2638-d6e5-42c5-9558-c22696424d74 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:55.021807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:55.028349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da2638-d6e5-42c5-9558-c22696424d74 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:55.061502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b0ddf-7344-4872-800c-bb14672994b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:55.062313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0ddf-7344-4872-800c-bb14672994b1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:55.062599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0ddf-7344-4872-800c-bb14672994b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:55.062875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0ddf-7344-4872-800c-bb14672994b1 None admin] PATH_INFO: `/v3/projects/3f55fce9f5b045dba17923a43dd80e9d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:55.064040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b0ddf-7344-4872-800c-bb14672994b1 None admin] RBAC: Authorizing `identity:get_project(project_id=3f55fce9f5b045dba17923a43dd80e9d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:55.065455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b0ddf-7344-4872-800c-bb14672994b1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:55.067154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 560/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:43:54 2022] GET /identity/v3/projects/3f55fce9f5b045dba17923a43dd80e9d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:55.073551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3537-da27-40ac-a6ab-6f6654a15a66 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:55.094806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:55.169877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3537-da27-40ac-a6ab-6f6654a15a66 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:55.202414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a327c3-6c70-455b-82bb-f2776af7abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:55.203283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a327c3-6c70-455b-82bb-f2776af7abc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:55.203568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a327c3-6c70-455b-82bb-f2776af7abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:55.203846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a327c3-6c70-455b-82bb-f2776af7abc9 None admin] PATH_INFO: `/v3/projects/3f55fce9f5b045dba17923a43dd80e9d/users/f803e78b821241c1b479fe3fec5ad07d/roles/23dcaf1f585d4a03a6101a69a6bdd9f1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:55.206011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a327c3-6c70-455b-82bb-f2776af7abc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3f55fce9f5b045dba17923a43dd80e9d, user_id=f803e78b821241c1b479fe3fec5ad07d, role_id=23dcaf1f585d4a03a6101a69a6bdd9f1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:55.207428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a327c3-6c70-455b-82bb-f2776af7abc9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:55.305070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 563/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:43:55 2022] PUT /identity/v3/projects/3f55fce9f5b045dba17923a43dd80e9d/users/f803e78b821241c1b479fe3fec5ad07d/roles/23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:43:57.302454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf065-bc26-4e13-a8d6-d31924d23076 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:57.302998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf065-bc26-4e13-a8d6-d31924d23076 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:57.302998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf065-bc26-4e13-a8d6-d31924d23076 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:57.304360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 561/1124] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:43:57.309497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b73f8-7b80-4a4c-9aeb-0459df7ed615 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:57.309922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b73f8-7b80-4a4c-9aeb-0459df7ed615 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:57.310077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b73f8-7b80-4a4c-9aeb-0459df7ed615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:57.326854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-295b73f8-7b80-4a4c-9aeb-0459df7ed615 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:43:57.328036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-295b73f8-7b80-4a4c-9aeb-0459df7ed615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:43:57.394784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 564/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:43:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:43:57.419830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf065-bc26-4e13-a8d6-d31924d23076 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:57.518637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf065-bc26-4e13-a8d6-d31924d23076 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:57.552200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936e80-55b2-4688-9d4c-9b4d757dd1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:57.553086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936e80-55b2-4688-9d4c-9b4d757dd1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:57.553322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936e80-55b2-4688-9d4c-9b4d757dd1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:57.553596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936e80-55b2-4688-9d4c-9b4d757dd1a6 None admin] PATH_INFO: `/v3/roles/23dcaf1f585d4a03a6101a69a6bdd9f1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:57.555081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba936e80-55b2-4688-9d4c-9b4d757dd1a6 None admin] RBAC: Authorizing `identity:get_role(role_id=23dcaf1f585d4a03a6101a69a6bdd9f1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:57.556770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba936e80-55b2-4688-9d4c-9b4d757dd1a6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:57.558151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 562/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:57 2022] GET /identity/v3/roles/23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:57.563975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b73f8-7b80-4a4c-9aeb-0459df7ed615 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:57.576022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:57.659859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b73f8-7b80-4a4c-9aeb-0459df7ed615 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:57.692130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b9fa-be77-4676-9f85-7ee6d1da2bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:57.692979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b9fa-be77-4676-9f85-7ee6d1da2bcd None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:57.693261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b9fa-be77-4676-9f85-7ee6d1da2bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:57.693533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830b9fa-be77-4676-9f85-7ee6d1da2bcd None admin] PATH_INFO: `/v3/users/f803e78b821241c1b479fe3fec5ad07d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:57.694700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830b9fa-be77-4676-9f85-7ee6d1da2bcd None admin] RBAC: Authorizing `identity:get_user(user_id=f803e78b821241c1b479fe3fec5ad07d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:57.696096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830b9fa-be77-4676-9f85-7ee6d1da2bcd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:57.698417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 565/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:43:57 2022] GET /identity/v3/users/f803e78b821241c1b479fe3fec5ad07d => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:43:57.704160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936e80-55b2-4688-9d4c-9b4d757dd1a6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:57.733958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:57.801973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936e80-55b2-4688-9d4c-9b4d757dd1a6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:57.836549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faafd9-a1fb-4c6c-8b1c-e9d874aade03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:57.837132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faafd9-a1fb-4c6c-8b1c-e9d874aade03 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:57.837462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faafd9-a1fb-4c6c-8b1c-e9d874aade03 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:57.837869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faafd9-a1fb-4c6c-8b1c-e9d874aade03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:57.905191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faafd9-a1fb-4c6c-8b1c-e9d874aade03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:57.906653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faafd9-a1fb-4c6c-8b1c-e9d874aade03 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:57.934941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:58.001372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 563/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:43:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:43:58.007462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b9fa-be77-4676-9f85-7ee6d1da2bcd None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:58.084593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:58.105001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830b9fa-be77-4676-9f85-7ee6d1da2bcd None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:58.139157 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5fabb-263b-480f-920f-656d1741b41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:58.139999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5fabb-263b-480f-920f-656d1741b41b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:58.140283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5fabb-263b-480f-920f-656d1741b41b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:58.140560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5fabb-263b-480f-920f-656d1741b41b None admin] PATH_INFO: `/v3/projects/3f55fce9f5b045dba17923a43dd80e9d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:58.141719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5fabb-263b-480f-920f-656d1741b41b None admin] RBAC: Authorizing `identity:get_project(project_id=3f55fce9f5b045dba17923a43dd80e9d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:58.143149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5fabb-263b-480f-920f-656d1741b41b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:58.144829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 566/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:43:58 2022] GET /identity/v3/projects/3f55fce9f5b045dba17923a43dd80e9d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:43:58.150941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faafd9-a1fb-4c6c-8b1c-e9d874aade03 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:43:58.246131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faafd9-a1fb-4c6c-8b1c-e9d874aade03 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:43:58.273100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:43:58.278965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239c44-b815-4b8f-9ba7-1d2b52b33282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:43:58.279604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239c44-b815-4b8f-9ba7-1d2b52b33282 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:43:58.279891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239c44-b815-4b8f-9ba7-1d2b52b33282 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:43:58.280168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239c44-b815-4b8f-9ba7-1d2b52b33282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:43:58.280983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39239c44-b815-4b8f-9ba7-1d2b52b33282 None admin] RBAC: Adding query filter params (role.id=23dcaf1f585d4a03a6101a69a6bdd9f1, scope.project.id=3f55fce9f5b045dba17923a43dd80e9d, user.id=f803e78b821241c1b479fe3fec5ad07d) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:43:58.281313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39239c44-b815-4b8f-9ba7-1d2b52b33282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:43:58.282737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39239c44-b815-4b8f-9ba7-1d2b52b33282 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:43:58.288381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 564/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:43:58 2022] GET /identity/v3/role_assignments?user.id=f803e78b821241c1b479fe3fec5ad07d&scope.project.id=3f55fce9f5b045dba17923a43dd80e9d&role.id=23dcaf1f585d4a03a6101a69a6bdd9f1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:00.309994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06388897-e532-4f0a-8d11-f470adcec7b7 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:00.310551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06388897-e532-4f0a-8d11-f470adcec7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:00.310551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06388897-e532-4f0a-8d11-f470adcec7b7 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:00.311938 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 567/1131] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:00.317269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314882-1e2e-4ab4-aff5-97718c88cf1e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:00.317687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314882-1e2e-4ab4-aff5-97718c88cf1e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:00.317825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f314882-1e2e-4ab4-aff5-97718c88cf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:00.334775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9f314882-1e2e-4ab4-aff5-97718c88cf1e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:00.335937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9f314882-1e2e-4ab4-aff5-97718c88cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:00.401011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 565/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:00.424669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06388897-e532-4f0a-8d11-f470adcec7b7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:00.523765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06388897-e532-4f0a-8d11-f470adcec7b7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:00.557670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f4cf9-f32b-4fff-882f-d7d9f51feab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:00.558465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f4cf9-f32b-4fff-882f-d7d9f51feab4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:00.558748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f4cf9-f32b-4fff-882f-d7d9f51feab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:00.559019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f4cf9-f32b-4fff-882f-d7d9f51feab4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:00.560226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f4cf9-f32b-4fff-882f-d7d9f51feab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:00.561573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f4cf9-f32b-4fff-882f-d7d9f51feab4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:00.563188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 568/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:00.572803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f314882-1e2e-4ab4-aff5-97718c88cf1e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:00.666170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f314882-1e2e-4ab4-aff5-97718c88cf1e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:00.688778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:00.699147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559e253-509c-4c3e-9348-2cb3dd7b5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:00.699795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559e253-509c-4c3e-9348-2cb3dd7b5cda None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:00.700081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559e253-509c-4c3e-9348-2cb3dd7b5cda None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:00.700357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559e253-509c-4c3e-9348-2cb3dd7b5cda None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:00.701055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559e253-509c-4c3e-9348-2cb3dd7b5cda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:00.702494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559e253-509c-4c3e-9348-2cb3dd7b5cda None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:00.786912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 566/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:44:00 2022] POST /identity/v3/projects => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:44:02.845509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b7ee9-94aa-44fc-a3a7-f762a8c37b15 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:02.845958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b7ee9-94aa-44fc-a3a7-f762a8c37b15 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:02.846121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b7ee9-94aa-44fc-a3a7-f762a8c37b15 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:02.847506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 569/1135] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:02.852757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ec213-16a1-4eac-802e-fff429d41a80 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:02.853177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ec213-16a1-4eac-802e-fff429d41a80 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:02.853312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ec213-16a1-4eac-802e-fff429d41a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:02.869575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a31ec213-16a1-4eac-802e-fff429d41a80 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:02.870775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a31ec213-16a1-4eac-802e-fff429d41a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:02.934640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 567/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:02.959181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b7ee9-94aa-44fc-a3a7-f762a8c37b15 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:02.974993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:03.058081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b7ee9-94aa-44fc-a3a7-f762a8c37b15 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:03.090650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd5354-a3c1-402c-a858-bc07e82b31b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:03.091373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5354-a3c1-402c-a858-bc07e82b31b7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:03.091656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5354-a3c1-402c-a858-bc07e82b31b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:03.091933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd5354-a3c1-402c-a858-bc07e82b31b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:03.093091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd5354-a3c1-402c-a858-bc07e82b31b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:03.094531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd5354-a3c1-402c-a858-bc07e82b31b7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:03.096140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 570/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:44:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:03.101716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ec213-16a1-4eac-802e-fff429d41a80 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:03.197799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ec213-16a1-4eac-802e-fff429d41a80 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:03.204833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:03.230154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853ee2-4a9f-450e-9eb5-88145807e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:03.230802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853ee2-4a9f-450e-9eb5-88145807e878 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:03.231088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853ee2-4a9f-450e-9eb5-88145807e878 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:03.231364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853ee2-4a9f-450e-9eb5-88145807e878 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:03.232061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91853ee2-4a9f-450e-9eb5-88145807e878 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:03.233474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91853ee2-4a9f-450e-9eb5-88145807e878 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:03.340522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 568/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:44:03 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:44:05.386823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079a6fa-c331-4135-9fc3-088bf0bc8c23 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:05.387372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079a6fa-c331-4135-9fc3-088bf0bc8c23 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:05.387372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079a6fa-c331-4135-9fc3-088bf0bc8c23 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:05.388723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 571/1139] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:05.393843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b5e2-d510-4918-aa7a-e144f4ed25b0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:05.394308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b5e2-d510-4918-aa7a-e144f4ed25b0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:05.394441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690b5e2-d510-4918-aa7a-e144f4ed25b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:05.411283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7690b5e2-d510-4918-aa7a-e144f4ed25b0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:05.412449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7690b5e2-d510-4918-aa7a-e144f4ed25b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:05.476775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 569/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:44:05.500561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079a6fa-c331-4135-9fc3-088bf0bc8c23 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:05.579781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:05.597703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079a6fa-c331-4135-9fc3-088bf0bc8c23 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:05.630797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c07f9-8b25-4512-8113-f9bfcf01990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:05.631566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c07f9-8b25-4512-8113-f9bfcf01990e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:05.631847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c07f9-8b25-4512-8113-f9bfcf01990e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:05.632119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c07f9-8b25-4512-8113-f9bfcf01990e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:05.642627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c07f9-8b25-4512-8113-f9bfcf01990e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-098c07f9-8b25-4512-8113-f9bfcf01990e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:44:05.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:44:05.651315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:44:05.652416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 572/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:44:05.657222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690b5e2-d510-4918-aa7a-e144f4ed25b0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:05.747240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:05.755627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690b5e2-d510-4918-aa7a-e144f4ed25b0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:05.789280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:05.789932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:05.790822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:05.791100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:05.791880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:05.792282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:05.793677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:05.802371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 570/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:05.808973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c07f9-8b25-4512-8113-f9bfcf01990e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:05.908951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c07f9-8b25-4512-8113-f9bfcf01990e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:05.942421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e81b3-cd23-402e-b7d0-735bc81a3b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:05.943287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e81b3-cd23-402e-b7d0-735bc81a3b3f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:05.943576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e81b3-cd23-402e-b7d0-735bc81a3b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:05.943853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e81b3-cd23-402e-b7d0-735bc81a3b3f None admin] PATH_INFO: `/v3/users/0afba11419894797a7b8e76c62087476` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:05.955115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:05.957476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e81b3-cd23-402e-b7d0-735bc81a3b3f None admin] RBAC: Authorizing `identity:get_user(user_id=0afba11419894797a7b8e76c62087476)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:05.958912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e81b3-cd23-402e-b7d0-735bc81a3b3f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:05.960564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 573/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:44:05 2022] GET /identity/v3/users/0afba11419894797a7b8e76c62087476 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:05.967022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:06.064149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae4a1a-86a8-447e-a041-c7f1bb721d71 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:06.096378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f11eb-af50-4ebf-a825-7dddb65b1e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:06.097007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f11eb-af50-4ebf-a825-7dddb65b1e77 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:06.097288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f11eb-af50-4ebf-a825-7dddb65b1e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:06.097561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f11eb-af50-4ebf-a825-7dddb65b1e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:06.120488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:06.162617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f11eb-af50-4ebf-a825-7dddb65b1e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:06.163971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f11eb-af50-4ebf-a825-7dddb65b1e77 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:06.256556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 571/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:44:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:44:06.263350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e81b3-cd23-402e-b7d0-735bc81a3b3f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:06.360276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e81b3-cd23-402e-b7d0-735bc81a3b3f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:06.392840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97526965-343e-4c93-83c4-8dff53f6e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:06.393683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526965-343e-4c93-83c4-8dff53f6e9ff None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:06.393967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526965-343e-4c93-83c4-8dff53f6e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:06.394274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526965-343e-4c93-83c4-8dff53f6e9ff None admin] PATH_INFO: `/v3/projects/590a15d4d21b481ab247d6f71cd4f29a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:06.395438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97526965-343e-4c93-83c4-8dff53f6e9ff None admin] RBAC: Authorizing `identity:get_project(project_id=590a15d4d21b481ab247d6f71cd4f29a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:06.396829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97526965-343e-4c93-83c4-8dff53f6e9ff None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:06.398628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 574/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:44:06 2022] GET /identity/v3/projects/590a15d4d21b481ab247d6f71cd4f29a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:06.405669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f11eb-af50-4ebf-a825-7dddb65b1e77 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:06.459399 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:06.503233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f11eb-af50-4ebf-a825-7dddb65b1e77 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:06.535255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fd532-298a-4133-90ab-7ad5fae8b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:06.535896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fd532-298a-4133-90ab-7ad5fae8b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:06.536179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fd532-298a-4133-90ab-7ad5fae8b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:06.536456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fd532-298a-4133-90ab-7ad5fae8b0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:06.537280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fd532-298a-4133-90ab-7ad5fae8b0a2 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=590a15d4d21b481ab247d6f71cd4f29a, user.id=0afba11419894797a7b8e76c62087476) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:06.537595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fd532-298a-4133-90ab-7ad5fae8b0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:06.539064 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fd532-298a-4133-90ab-7ad5fae8b0a2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:06.544892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 572/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:44:06 2022] GET /identity/v3/role_assignments?user.id=0afba11419894797a7b8e76c62087476&scope.project.id=590a15d4d21b481ab247d6f71cd4f29a&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:08.519080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd6c09-8618-4c14-a49a-48b85bc6413a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:08.519623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd6c09-8618-4c14-a49a-48b85bc6413a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:08.519623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd6c09-8618-4c14-a49a-48b85bc6413a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:08.520994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 575/1147] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:08.526848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517862-31ed-4a68-924d-c9bbebd457b8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:08.527276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517862-31ed-4a68-924d-c9bbebd457b8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:08.527405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99517862-31ed-4a68-924d-c9bbebd457b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:08.544225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-99517862-31ed-4a68-924d-c9bbebd457b8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:08.545392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-99517862-31ed-4a68-924d-c9bbebd457b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:08.610326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 573/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:08.632459 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd6c09-8618-4c14-a49a-48b85bc6413a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:08.700337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:08.733419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd6c09-8618-4c14-a49a-48b85bc6413a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:08.767227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e6421-3da9-4540-b632-7b7e9a42dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:08.768009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e6421-3da9-4540-b632-7b7e9a42dac2 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:08.768296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e6421-3da9-4540-b632-7b7e9a42dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:08.768577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e6421-3da9-4540-b632-7b7e9a42dac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:08.779441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e6421-3da9-4540-b632-7b7e9a42dac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-cf0e6421-3da9-4540-b632-7b7e9a42dac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:44:08.787086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:44:08.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:44:08.789084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 576/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:44:08.794658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517862-31ed-4a68-924d-c9bbebd457b8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:08.842780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:08.893301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99517862-31ed-4a68-924d-c9bbebd457b8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:08.927409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:08.928068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:08.928355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:08.928637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:08.929382 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:08.929693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:08.931115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:08.938932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 574/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:08.944670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e6421-3da9-4540-b632-7b7e9a42dac2 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:09.041806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e6421-3da9-4540-b632-7b7e9a42dac2 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:09.066529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:09.074803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f41c85-19c9-4bdd-89c2-d713c147a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:09.075660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f41c85-19c9-4bdd-89c2-d713c147a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:09.075943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f41c85-19c9-4bdd-89c2-d713c147a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:09.076217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f41c85-19c9-4bdd-89c2-d713c147a7f4 None admin] PATH_INFO: `/v3/users/0afba11419894797a7b8e76c62087476` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:09.077381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f41c85-19c9-4bdd-89c2-d713c147a7f4 None admin] RBAC: Authorizing `identity:get_user(user_id=0afba11419894797a7b8e76c62087476)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:09.078804 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f41c85-19c9-4bdd-89c2-d713c147a7f4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:09.080405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 577/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:44:08 2022] GET /identity/v3/users/0afba11419894797a7b8e76c62087476 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:09.086118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:09.185719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7f40-8922-42c7-9224-cf1d614e84e5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:09.195509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:09.219183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fdc7e-5896-43ed-91c6-000162a64e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:09.220047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fdc7e-5896-43ed-91c6-000162a64e45 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:09.220526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fdc7e-5896-43ed-91c6-000162a64e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:09.221083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fdc7e-5896-43ed-91c6-000162a64e45 None admin] PATH_INFO: `/v3/projects/590a15d4d21b481ab247d6f71cd4f29a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:09.222344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fdc7e-5896-43ed-91c6-000162a64e45 None admin] RBAC: Authorizing `identity:get_project(project_id=590a15d4d21b481ab247d6f71cd4f29a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:09.223761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fdc7e-5896-43ed-91c6-000162a64e45 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:09.225439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 575/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:44:09 2022] GET /identity/v3/projects/590a15d4d21b481ab247d6f71cd4f29a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:09.231710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f41c85-19c9-4bdd-89c2-d713c147a7f4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:09.328484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f41c85-19c9-4bdd-89c2-d713c147a7f4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:09.361110 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efc7a6-d1c2-40f1-8919-b0b5a226d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:09.361977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efc7a6-d1c2-40f1-8919-b0b5a226d838 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:09.362288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efc7a6-d1c2-40f1-8919-b0b5a226d838 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:09.362565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efc7a6-d1c2-40f1-8919-b0b5a226d838 None admin] PATH_INFO: `/v3/projects/590a15d4d21b481ab247d6f71cd4f29a/users/0afba11419894797a7b8e76c62087476/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:09.364508 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efc7a6-d1c2-40f1-8919-b0b5a226d838 None admin] RBAC: Authorizing `identity:create_grant(project_id=590a15d4d21b481ab247d6f71cd4f29a, user_id=0afba11419894797a7b8e76c62087476, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:09.365898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efc7a6-d1c2-40f1-8919-b0b5a226d838 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:09.448282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 578/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:44:09 2022] PUT /identity/v3/projects/590a15d4d21b481ab247d6f71cd4f29a/users/0afba11419894797a7b8e76c62087476/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:44:11.435082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e481a0-a6a6-44ce-8f7f-479cb56d5443 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:11.435675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e481a0-a6a6-44ce-8f7f-479cb56d5443 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:11.435675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e481a0-a6a6-44ce-8f7f-479cb56d5443 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:11.436979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 576/1154] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:11.442230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6b06-8039-4ad8-8d7a-11b2fa9183fa None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:11.442645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6b06-8039-4ad8-8d7a-11b2fa9183fa None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:11.442788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6b06-8039-4ad8-8d7a-11b2fa9183fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:11.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6d4c6b06-8039-4ad8-8d7a-11b2fa9183fa None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:11.460854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6d4c6b06-8039-4ad8-8d7a-11b2fa9183fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:11.508306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:11.524700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 579/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:11.548222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e481a0-a6a6-44ce-8f7f-479cb56d5443 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:11.648429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e481a0-a6a6-44ce-8f7f-479cb56d5443 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:11.681044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa21ed-d23c-4534-957e-7c09f48a6b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:11.681883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa21ed-d23c-4534-957e-7c09f48a6b3e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:11.682199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa21ed-d23c-4534-957e-7c09f48a6b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:11.682472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa21ed-d23c-4534-957e-7c09f48a6b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:11.692170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa21ed-d23c-4534-957e-7c09f48a6b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b4aa21ed-d23c-4534-957e-7c09f48a6b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:44:11.699680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:44:11.700724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:44:11.701738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 577/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:44:11.706856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6b06-8039-4ad8-8d7a-11b2fa9183fa None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:11.802020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6b06-8039-4ad8-8d7a-11b2fa9183fa None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:11.835054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:11.835716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:11.835995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:11.836267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:11.837054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:11.837361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:11.838742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:11.846838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 580/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:11.853141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa21ed-d23c-4534-957e-7c09f48a6b3e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:11.893182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:11.951841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa21ed-d23c-4534-957e-7c09f48a6b3e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:11.985731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629fbdc-b18d-40cf-94eb-aa1ab09194f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:11.986605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629fbdc-b18d-40cf-94eb-aa1ab09194f9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:11.986889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629fbdc-b18d-40cf-94eb-aa1ab09194f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:11.987163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629fbdc-b18d-40cf-94eb-aa1ab09194f9 None admin] PATH_INFO: `/v3/users/0afba11419894797a7b8e76c62087476` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:11.988334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629fbdc-b18d-40cf-94eb-aa1ab09194f9 None admin] RBAC: Authorizing `identity:get_user(user_id=0afba11419894797a7b8e76c62087476)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:11.989755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629fbdc-b18d-40cf-94eb-aa1ab09194f9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:11.991384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 578/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:44:11 2022] GET /identity/v3/users/0afba11419894797a7b8e76c62087476 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:11.997713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:12.046303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:12.094543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a7fbb-c9a1-430f-97f6-88d766c31997 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:12.126702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34af62-70fc-4973-b44e-6f809f8dc414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:12.127333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34af62-70fc-4973-b44e-6f809f8dc414 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:12.127616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34af62-70fc-4973-b44e-6f809f8dc414 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:12.127891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34af62-70fc-4973-b44e-6f809f8dc414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:12.191893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34af62-70fc-4973-b44e-6f809f8dc414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:12.193308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34af62-70fc-4973-b44e-6f809f8dc414 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:12.238657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:12.288490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 581/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:44:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:44:12.295073 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629fbdc-b18d-40cf-94eb-aa1ab09194f9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:12.392388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629fbdc-b18d-40cf-94eb-aa1ab09194f9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:12.400286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:12.426742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606082b-0ca5-4bb5-a647-47b6ef8d9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:12.427586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606082b-0ca5-4bb5-a647-47b6ef8d9c0b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:12.427872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606082b-0ca5-4bb5-a647-47b6ef8d9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:12.428152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606082b-0ca5-4bb5-a647-47b6ef8d9c0b None admin] PATH_INFO: `/v3/projects/590a15d4d21b481ab247d6f71cd4f29a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:12.429454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606082b-0ca5-4bb5-a647-47b6ef8d9c0b None admin] RBAC: Authorizing `identity:get_project(project_id=590a15d4d21b481ab247d6f71cd4f29a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:12.431223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606082b-0ca5-4bb5-a647-47b6ef8d9c0b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:12.432899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 579/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:44:12 2022] GET /identity/v3/projects/590a15d4d21b481ab247d6f71cd4f29a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:12.438946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34af62-70fc-4973-b44e-6f809f8dc414 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:12.534883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34af62-70fc-4973-b44e-6f809f8dc414 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:12.567904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76a4c1-a464-4306-bc3d-41d3706272dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:12.568542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a4c1-a464-4306-bc3d-41d3706272dc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:12.568826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a4c1-a464-4306-bc3d-41d3706272dc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:12.569101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76a4c1-a464-4306-bc3d-41d3706272dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:12.569916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76a4c1-a464-4306-bc3d-41d3706272dc None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=590a15d4d21b481ab247d6f71cd4f29a, user.id=0afba11419894797a7b8e76c62087476) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:12.570252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76a4c1-a464-4306-bc3d-41d3706272dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:12.571688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76a4c1-a464-4306-bc3d-41d3706272dc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:12.577332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 582/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:44:12 2022] GET /identity/v3/role_assignments?user.id=0afba11419894797a7b8e76c62087476&scope.project.id=590a15d4d21b481ab247d6f71cd4f29a&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:14.605126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ba6ad-ceb8-41a2-9a9f-e5e3cd425ab6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:14.605653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ba6ad-ceb8-41a2-9a9f-e5e3cd425ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:14.605653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ba6ad-ceb8-41a2-9a9f-e5e3cd425ab6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:14.607077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 580/1162] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:14.612318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adfa83-b587-421e-9f2a-f0707c479150 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:14.612684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adfa83-b587-421e-9f2a-f0707c479150 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:14.612874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adfa83-b587-421e-9f2a-f0707c479150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:14.629597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-98adfa83-b587-421e-9f2a-f0707c479150 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:14.630805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-98adfa83-b587-421e-9f2a-f0707c479150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:14.638699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:14.695626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 583/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:14.718345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ba6ad-ceb8-41a2-9a9f-e5e3cd425ab6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:14.823212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ba6ad-ceb8-41a2-9a9f-e5e3cd425ab6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:14.856951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e3c01-f791-4e9e-97e7-672083930602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:14.857589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e3c01-f791-4e9e-97e7-672083930602 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:14.857884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e3c01-f791-4e9e-97e7-672083930602 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:14.858192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e3c01-f791-4e9e-97e7-672083930602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:14.899081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:14.923844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e3c01-f791-4e9e-97e7-672083930602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:14.925273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e3c01-f791-4e9e-97e7-672083930602 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:15.021332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 581/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:44:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:44:15.029075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adfa83-b587-421e-9f2a-f0707c479150 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:15.123631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adfa83-b587-421e-9f2a-f0707c479150 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:15.156471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30991630-7038-4fd0-91f7-cbc76a753fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:15.157253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30991630-7038-4fd0-91f7-cbc76a753fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:15.157535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30991630-7038-4fd0-91f7-cbc76a753fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:15.157809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30991630-7038-4fd0-91f7-cbc76a753fa8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:15.164284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30991630-7038-4fd0-91f7-cbc76a753fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:15.166468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30991630-7038-4fd0-91f7-cbc76a753fa8 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-30991630-7038-4fd0-91f7-cbc76a753fa8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:44:15.180352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:44:15.181545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:44:15.182917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 584/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:44:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:44:15.187367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e3c01-f791-4e9e-97e7-672083930602 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:15.258654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:15.283381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e3c01-f791-4e9e-97e7-672083930602 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:15.316274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c31a9b-f9ff-4346-9cea-c334ff8fd1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:15.316919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c31a9b-f9ff-4346-9cea-c334ff8fd1dd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:15.317202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c31a9b-f9ff-4346-9cea-c334ff8fd1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:15.317476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c31a9b-f9ff-4346-9cea-c334ff8fd1dd None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:15.318221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c31a9b-f9ff-4346-9cea-c334ff8fd1dd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:15.318529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c31a9b-f9ff-4346-9cea-c334ff8fd1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:15.319881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c31a9b-f9ff-4346-9cea-c334ff8fd1dd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:15.327004 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 582/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 22 08:44:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:17.344234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127ad0-428d-443b-a941-d559ea088dfd None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:17.344760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127ad0-428d-443b-a941-d559ea088dfd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:17.344760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66127ad0-428d-443b-a941-d559ea088dfd None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:17.346164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 585/1167] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:17.351387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9004f-223e-4a80-8dc7-0b42f9415c11 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:17.351821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9004f-223e-4a80-8dc7-0b42f9415c11 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:17.352597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9004f-223e-4a80-8dc7-0b42f9415c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:17.369177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c8f9004f-223e-4a80-8dc7-0b42f9415c11 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:17.370391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c8f9004f-223e-4a80-8dc7-0b42f9415c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:17.435522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 583/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:44:17.458245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66127ad0-428d-443b-a941-d559ea088dfd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:17.462350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:17.558881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66127ad0-428d-443b-a941-d559ea088dfd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:17.591577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c6a18-269f-40e2-a6d5-7a1477b169dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:17.592221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6a18-269f-40e2-a6d5-7a1477b169dc None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:17.592505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6a18-269f-40e2-a6d5-7a1477b169dc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:17.592783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c6a18-269f-40e2-a6d5-7a1477b169dc None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:17.593526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c6a18-269f-40e2-a6d5-7a1477b169dc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:17.594945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c6a18-269f-40e2-a6d5-7a1477b169dc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:17.672417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 586/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Wed Jun 22 08:44:17 2022] POST /identity/v3/domains => generated 267 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:44:19.722417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48892-7678-4200-aa01-709cd63925df None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:19.722948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48892-7678-4200-aa01-709cd63925df None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:19.722948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b48892-7678-4200-aa01-709cd63925df None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:19.724332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 584/1170] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:19.729652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555e38-4c1b-4eaa-9a63-20ffe9260a88 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:19.730078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555e38-4c1b-4eaa-9a63-20ffe9260a88 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:19.730236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555e38-4c1b-4eaa-9a63-20ffe9260a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:19.747326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-14555e38-4c1b-4eaa-9a63-20ffe9260a88 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:19.748489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-14555e38-4c1b-4eaa-9a63-20ffe9260a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:19.804352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:19.814517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 587/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:19.839277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b48892-7678-4200-aa01-709cd63925df None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:19.905566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:19.938894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b48892-7678-4200-aa01-709cd63925df None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:19.971747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64fd0-a3d6-42df-b69e-758863d07312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:19.972649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64fd0-a3d6-42df-b69e-758863d07312 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:19.972885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64fd0-a3d6-42df-b69e-758863d07312 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:19.973162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64fd0-a3d6-42df-b69e-758863d07312 None admin] PATH_INFO: `/v3/domains/9695bebd85e543b09b88b771dffdfa19` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:19.983836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa64fd0-a3d6-42df-b69e-758863d07312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9695bebd85e543b09b88b771dffdfa19)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:19.985262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa64fd0-a3d6-42df-b69e-758863d07312 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:19.986901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 585/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Wed Jun 22 08:44:19 2022] GET /identity/v3/domains/9695bebd85e543b09b88b771dffdfa19 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:19.993025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555e38-4c1b-4eaa-9a63-20ffe9260a88 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:20.092001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555e38-4c1b-4eaa-9a63-20ffe9260a88 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:20.124944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6298447-3025-4d91-8bd5-892de8d6a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:20.125593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6298447-3025-4d91-8bd5-892de8d6a7b6 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:20.125879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6298447-3025-4d91-8bd5-892de8d6a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:20.126195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6298447-3025-4d91-8bd5-892de8d6a7b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:20.126911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6298447-3025-4d91-8bd5-892de8d6a7b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:20.128323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6298447-3025-4d91-8bd5-892de8d6a7b6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:20.225504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 588/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:44:19 2022] POST /identity/v3/projects => generated 361 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:44:22.290932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362286-1d0a-47c5-8be6-3d74e7022a7c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:22.291554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362286-1d0a-47c5-8be6-3d74e7022a7c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:22.291554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12362286-1d0a-47c5-8be6-3d74e7022a7c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:22.292835 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 586/1174] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:22.298115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1902-f454-41af-8f22-a6e25a5696a0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:22.298538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1902-f454-41af-8f22-a6e25a5696a0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:22.298682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1902-f454-41af-8f22-a6e25a5696a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:22.315617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-14fb1902-f454-41af-8f22-a6e25a5696a0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:22.316795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-14fb1902-f454-41af-8f22-a6e25a5696a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:22.354936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:22.380892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 589/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:22.405830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12362286-1d0a-47c5-8be6-3d74e7022a7c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:22.503094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12362286-1d0a-47c5-8be6-3d74e7022a7c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:22.528575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:22.535885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b39ee5-95e0-49e3-b9b6-b5b4885f4ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:22.537543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b39ee5-95e0-49e3-b9b6-b5b4885f4ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:22.537543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b39ee5-95e0-49e3-b9b6-b5b4885f4ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:22.537543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b39ee5-95e0-49e3-b9b6-b5b4885f4ca7 None admin] PATH_INFO: `/v3/domains/9695bebd85e543b09b88b771dffdfa19` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:22.538538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b39ee5-95e0-49e3-b9b6-b5b4885f4ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9695bebd85e543b09b88b771dffdfa19)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:22.540596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b39ee5-95e0-49e3-b9b6-b5b4885f4ca7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:22.542240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 587/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Wed Jun 22 08:44:22 2022] GET /identity/v3/domains/9695bebd85e543b09b88b771dffdfa19 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:22.547829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1902-f454-41af-8f22-a6e25a5696a0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:22.642684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1902-f454-41af-8f22-a6e25a5696a0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:22.675781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8b968-648a-458c-b46d-b137afd68857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:22.676432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b968-648a-458c-b46d-b137afd68857 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:22.676713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b968-648a-458c-b46d-b137afd68857 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:22.676990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b968-648a-458c-b46d-b137afd68857 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:22.677685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8b968-648a-458c-b46d-b137afd68857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:22.679110 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8b968-648a-458c-b46d-b137afd68857 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:22.825312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 590/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:44:22 2022] POST /identity/v3/users => generated 311 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:44:24.882556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5bea-7cc6-472a-8adb-b40d4e413377 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:24.883662 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5bea-7cc6-472a-8adb-b40d4e413377 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:24.883794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5bea-7cc6-472a-8adb-b40d4e413377 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:24.885434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 588/1178] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:24.890902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432252b-ec59-44f1-8b6d-653b3c51136f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:24.891324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432252b-ec59-44f1-8b6d-653b3c51136f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:24.891461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432252b-ec59-44f1-8b6d-653b3c51136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:24.907944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3432252b-ec59-44f1-8b6d-653b3c51136f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:24.909135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3432252b-ec59-44f1-8b6d-653b3c51136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:24.932397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:24.974147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 591/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:24.998369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5bea-7cc6-472a-8adb-b40d4e413377 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:25.098201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5bea-7cc6-472a-8adb-b40d4e413377 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:25.131552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88df2c9-69c3-45f0-8701-dc4793494808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:25.132325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df2c9-69c3-45f0-8701-dc4793494808 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:25.132613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df2c9-69c3-45f0-8701-dc4793494808 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:25.133511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88df2c9-69c3-45f0-8701-dc4793494808 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:25.143750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88df2c9-69c3-45f0-8701-dc4793494808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b88df2c9-69c3-45f0-8701-dc4793494808 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:44:25.151440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:44:25.152607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:44:25.153845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 589/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:44:25.158556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432252b-ec59-44f1-8b6d-653b3c51136f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:25.252700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432252b-ec59-44f1-8b6d-653b3c51136f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:25.284864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:25.285511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:25.285790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:25.286087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:25.286832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:25.287139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:25.288479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:25.296891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 592/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:25.302318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88df2c9-69c3-45f0-8701-dc4793494808 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:25.357301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:25.400852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88df2c9-69c3-45f0-8701-dc4793494808 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:25.432775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ab6a0-7d85-447b-8b18-94d793ff7f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:25.433619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ab6a0-7d85-447b-8b18-94d793ff7f2a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:25.433906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ab6a0-7d85-447b-8b18-94d793ff7f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:25.434217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ab6a0-7d85-447b-8b18-94d793ff7f2a None admin] PATH_INFO: `/v3/users/914b192ef9c24f8383b65ec64253c06e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:25.447711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ab6a0-7d85-447b-8b18-94d793ff7f2a None admin] RBAC: Authorizing `identity:get_user(user_id=914b192ef9c24f8383b65ec64253c06e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:25.449135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ab6a0-7d85-447b-8b18-94d793ff7f2a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:25.450782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 590/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:44:25 2022] GET /identity/v3/users/914b192ef9c24f8383b65ec64253c06e => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:25.456489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:25.481291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:25.553530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a651d1-d3c2-4967-9177-2fdb23406f3b None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:25.586702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073eecd-fbfb-4e2f-87f9-8f4a7817c641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:25.587334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073eecd-fbfb-4e2f-87f9-8f4a7817c641 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:25.587617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073eecd-fbfb-4e2f-87f9-8f4a7817c641 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:25.587891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073eecd-fbfb-4e2f-87f9-8f4a7817c641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:25.653160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073eecd-fbfb-4e2f-87f9-8f4a7817c641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:25.654544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073eecd-fbfb-4e2f-87f9-8f4a7817c641 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:25.677411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:25.750507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 593/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:44:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:44:25.756419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ab6a0-7d85-447b-8b18-94d793ff7f2a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:25.855025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ab6a0-7d85-447b-8b18-94d793ff7f2a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:25.869472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:25.890226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac8a9f-d4c9-4cb7-980d-a506b1beb429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:25.891078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8a9f-d4c9-4cb7-980d-a506b1beb429 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:25.891362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8a9f-d4c9-4cb7-980d-a506b1beb429 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:25.891637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac8a9f-d4c9-4cb7-980d-a506b1beb429 None admin] PATH_INFO: `/v3/projects/284ef628fc1a4c859e642bd973420604` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:25.892874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac8a9f-d4c9-4cb7-980d-a506b1beb429 None admin] RBAC: Authorizing `identity:get_project(project_id=284ef628fc1a4c859e642bd973420604)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:25.894474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac8a9f-d4c9-4cb7-980d-a506b1beb429 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:25.896163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 591/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:44:25 2022] GET /identity/v3/projects/284ef628fc1a4c859e642bd973420604 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:25.902803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073eecd-fbfb-4e2f-87f9-8f4a7817c641 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:25.999590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073eecd-fbfb-4e2f-87f9-8f4a7817c641 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:26.021207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:26.032279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7cc0f-8631-4e0e-8f7d-7e4eca1dd224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:26.032923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7cc0f-8631-4e0e-8f7d-7e4eca1dd224 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:26.033202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7cc0f-8631-4e0e-8f7d-7e4eca1dd224 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:26.033476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7cc0f-8631-4e0e-8f7d-7e4eca1dd224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:26.034320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7cc0f-8631-4e0e-8f7d-7e4eca1dd224 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=284ef628fc1a4c859e642bd973420604, user.id=914b192ef9c24f8383b65ec64253c06e) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:26.034628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7cc0f-8631-4e0e-8f7d-7e4eca1dd224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:26.036042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7cc0f-8631-4e0e-8f7d-7e4eca1dd224 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:26.041869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 594/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:44:25 2022] GET /identity/v3/role_assignments?user.id=914b192ef9c24f8383b65ec64253c06e&scope.project.id=284ef628fc1a4c859e642bd973420604&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:28.061187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659edea-3d53-4eb4-a549-743d533f6e4b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:28.061723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659edea-3d53-4eb4-a549-743d533f6e4b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:28.061723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659edea-3d53-4eb4-a549-743d533f6e4b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:28.063156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 592/1186] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:28.068407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dd9fb-4a8f-42fa-83e2-87ef43a3fb50 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:28.068827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dd9fb-4a8f-42fa-83e2-87ef43a3fb50 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:28.068956 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294dd9fb-4a8f-42fa-83e2-87ef43a3fb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:28.085856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-294dd9fb-4a8f-42fa-83e2-87ef43a3fb50 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:28.087043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-294dd9fb-4a8f-42fa-83e2-87ef43a3fb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:28.152207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 595/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:28.175252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659edea-3d53-4eb4-a549-743d533f6e4b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:28.274625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659edea-3d53-4eb4-a549-743d533f6e4b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:28.306811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d918ebc-be31-4c4b-9b10-8892daa48f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:28.307579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918ebc-be31-4c4b-9b10-8892daa48f7e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:28.307859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918ebc-be31-4c4b-9b10-8892daa48f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:28.308134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d918ebc-be31-4c4b-9b10-8892daa48f7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:28.317868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d918ebc-be31-4c4b-9b10-8892daa48f7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0d918ebc-be31-4c4b-9b10-8892daa48f7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:44:28.325822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:44:28.326973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:44:28.327852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 593/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:44:28.333010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dd9fb-4a8f-42fa-83e2-87ef43a3fb50 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:28.429262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294dd9fb-4a8f-42fa-83e2-87ef43a3fb50 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:28.444779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:28.463008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:28.463667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:28.463950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:28.464892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:28.464995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:28.465322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:28.466691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:28.474411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 596/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:28.480341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d918ebc-be31-4c4b-9b10-8892daa48f7e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:28.522615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:28.578202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d918ebc-be31-4c4b-9b10-8892daa48f7e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:28.609929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b74df-78e3-46bb-aaad-047033a39f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:28.610806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b74df-78e3-46bb-aaad-047033a39f77 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:28.611095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b74df-78e3-46bb-aaad-047033a39f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:28.611371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b74df-78e3-46bb-aaad-047033a39f77 None admin] PATH_INFO: `/v3/users/914b192ef9c24f8383b65ec64253c06e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:28.612541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b74df-78e3-46bb-aaad-047033a39f77 None admin] RBAC: Authorizing `identity:get_user(user_id=914b192ef9c24f8383b65ec64253c06e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:28.613952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b74df-78e3-46bb-aaad-047033a39f77 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:28.615579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 594/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:44:28 2022] GET /identity/v3/users/914b192ef9c24f8383b65ec64253c06e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:28.621973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:28.719530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae510d9-b74f-487e-bedc-4ba1958f1da4 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:28.751781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ae603-63c9-418d-8587-d05b727683f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:28.752620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ae603-63c9-418d-8587-d05b727683f6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:28.752900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ae603-63c9-418d-8587-d05b727683f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:28.753172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ae603-63c9-418d-8587-d05b727683f6 None admin] PATH_INFO: `/v3/projects/284ef628fc1a4c859e642bd973420604` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:28.754360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ae603-63c9-418d-8587-d05b727683f6 None admin] RBAC: Authorizing `identity:get_project(project_id=284ef628fc1a4c859e642bd973420604)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:28.755765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ae603-63c9-418d-8587-d05b727683f6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:28.757439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 597/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:44:28 2022] GET /identity/v3/projects/284ef628fc1a4c859e642bd973420604 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:28.764212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b74df-78e3-46bb-aaad-047033a39f77 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:28.861955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b74df-78e3-46bb-aaad-047033a39f77 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:28.871860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:28.894189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49130f-423f-4057-bb43-3aec7de24045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:28.895063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49130f-423f-4057-bb43-3aec7de24045 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:28.895351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49130f-423f-4057-bb43-3aec7de24045 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:28.895627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49130f-423f-4057-bb43-3aec7de24045 None admin] PATH_INFO: `/v3/projects/284ef628fc1a4c859e642bd973420604/users/914b192ef9c24f8383b65ec64253c06e/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:28.897551 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49130f-423f-4057-bb43-3aec7de24045 None admin] RBAC: Authorizing `identity:create_grant(project_id=284ef628fc1a4c859e642bd973420604, user_id=914b192ef9c24f8383b65ec64253c06e, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:28.899577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49130f-423f-4057-bb43-3aec7de24045 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:28.950584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 595/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:44:28 2022] PUT /identity/v3/projects/284ef628fc1a4c859e642bd973420604/users/914b192ef9c24f8383b65ec64253c06e/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:44:30.942499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716bd7b-d662-4f55-9334-c8af655d69a7 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:30.943041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716bd7b-d662-4f55-9334-c8af655d69a7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:30.943041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716bd7b-d662-4f55-9334-c8af655d69a7 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:30.944436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 598/1193] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:44:30.949999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433965ce-9527-4d52-87c8-7a174969efdc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:30.950446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433965ce-9527-4d52-87c8-7a174969efdc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:30.950592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433965ce-9527-4d52-87c8-7a174969efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:30.967627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-433965ce-9527-4d52-87c8-7a174969efdc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:44:30.968794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-433965ce-9527-4d52-87c8-7a174969efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:44:31.032703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 596/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:44:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:44:31.055965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716bd7b-d662-4f55-9334-c8af655d69a7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:31.102199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:31.155484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716bd7b-d662-4f55-9334-c8af655d69a7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:31.188178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb105f-a309-40a0-ad79-74a51d87af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:31.188962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb105f-a309-40a0-ad79-74a51d87af31 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:31.189247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb105f-a309-40a0-ad79-74a51d87af31 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:31.189527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb105f-a309-40a0-ad79-74a51d87af31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:31.200511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb105f-a309-40a0-ad79-74a51d87af31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-24bb105f-a309-40a0-ad79-74a51d87af31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:44:31.208054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:44:31.209125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:44:31.210195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 599/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:44:31.215272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433965ce-9527-4d52-87c8-7a174969efdc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:31.308228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:31.311118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433965ce-9527-4d52-87c8-7a174969efdc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:31.343286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:31.343937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:31.344222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:31.344497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:31.345235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:31.345541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:31.346919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:31.355591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 597/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:44:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:31.360948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb105f-a309-40a0-ad79-74a51d87af31 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:31.455950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb105f-a309-40a0-ad79-74a51d87af31 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:31.463123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:31.489125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e2a61-c573-420d-b007-2e911c05a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:31.489974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e2a61-c573-420d-b007-2e911c05a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:31.490286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e2a61-c573-420d-b007-2e911c05a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:31.490566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e2a61-c573-420d-b007-2e911c05a6e7 None admin] PATH_INFO: `/v3/users/914b192ef9c24f8383b65ec64253c06e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:31.491759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e2a61-c573-420d-b007-2e911c05a6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=914b192ef9c24f8383b65ec64253c06e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:31.493684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e2a61-c573-420d-b007-2e911c05a6e7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:31.495316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 600/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 22 08:44:31 2022] GET /identity/v3/users/914b192ef9c24f8383b65ec64253c06e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:31.501066 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:31.599226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457dea-b372-46c4-80dc-15cbc5bae269 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:31.633269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ac8d7-9b7b-4545-929f-5f494d1926bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:31.634102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac8d7-9b7b-4545-929f-5f494d1926bd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:31.634394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac8d7-9b7b-4545-929f-5f494d1926bd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:31.635025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ac8d7-9b7b-4545-929f-5f494d1926bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:31.664690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:31.701588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ac8d7-9b7b-4545-929f-5f494d1926bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:31.703055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ac8d7-9b7b-4545-929f-5f494d1926bd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:31.799857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 598/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:44:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:44:31.805828 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e2a61-c573-420d-b007-2e911c05a6e7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:31.902473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e2a61-c573-420d-b007-2e911c05a6e7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:31.935113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5806156-247d-4e99-99e1-1599d39ffdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:31.935955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806156-247d-4e99-99e1-1599d39ffdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:31.936237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806156-247d-4e99-99e1-1599d39ffdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:31.936512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5806156-247d-4e99-99e1-1599d39ffdf4 None admin] PATH_INFO: `/v3/projects/284ef628fc1a4c859e642bd973420604` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:31.937675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5806156-247d-4e99-99e1-1599d39ffdf4 None admin] RBAC: Authorizing `identity:get_project(project_id=284ef628fc1a4c859e642bd973420604)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:31.939102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5806156-247d-4e99-99e1-1599d39ffdf4 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:31.940771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 601/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 22 08:44:31 2022] GET /identity/v3/projects/284ef628fc1a4c859e642bd973420604 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:31.947766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ac8d7-9b7b-4545-929f-5f494d1926bd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:44:32.005003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:32.043161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ac8d7-9b7b-4545-929f-5f494d1926bd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:44:32.075474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892b5e-e6be-4f43-b343-eb060319cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:44:32.076112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892b5e-e6be-4f43-b343-eb060319cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:44:32.076391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892b5e-e6be-4f43-b343-eb060319cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:44:32.076663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892b5e-e6be-4f43-b343-eb060319cbc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:44:32.077487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892b5e-e6be-4f43-b343-eb060319cbc7 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=284ef628fc1a4c859e642bd973420604, user.id=914b192ef9c24f8383b65ec64253c06e) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:44:32.077795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892b5e-e6be-4f43-b343-eb060319cbc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:44:32.079230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892b5e-e6be-4f43-b343-eb060319cbc7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:44:32.084830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 599/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:44:31 2022] GET /identity/v3/role_assignments?user.id=914b192ef9c24f8383b65ec64253c06e&scope.project.id=284ef628fc1a4c859e642bd973420604&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:44:41.931033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=79 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:44:42.082265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=37 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:43.083411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7f226-0e43-48a6-9a72-4d7abf492a36 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:43.084647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7f226-0e43-48a6-9a72-4d7abf492a36 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:43.084647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7f226-0e43-48a6-9a72-4d7abf492a36 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:43.085953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 602/1201] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:45:43.091137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfe7f6-e677-4057-b8f0-b288832dff66 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:43.091528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfe7f6-e677-4057-b8f0-b288832dff66 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:43.091637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfe7f6-e677-4057-b8f0-b288832dff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:43.108663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8adfe7f6-e677-4057-b8f0-b288832dff66 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:45:43.109835 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8adfe7f6-e677-4057-b8f0-b288832dff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:45:43.176437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 600/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:45:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:45:43.201249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7f226-0e43-48a6-9a72-4d7abf492a36 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:43.302882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7f226-0e43-48a6-9a72-4d7abf492a36 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:43.336662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:43.337436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:43.337716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:43.337988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:43.348000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:43.349357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:43.367119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:43.368218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:43.369558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:43.369558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:43.369558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:43.369558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:43.369558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 603/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:43.374326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfe7f6-e677-4057-b8f0-b288832dff66 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:43.470810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfe7f6-e677-4057-b8f0-b288832dff66 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:43.498516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:43.504229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3327003-1b9c-43c2-b8f9-d3f6ef581fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:43.504904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327003-1b9c-43c2-b8f9-d3f6ef581fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:43.505185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327003-1b9c-43c2-b8f9-d3f6ef581fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:43.505458 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3327003-1b9c-43c2-b8f9-d3f6ef581fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:43.507121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3327003-1b9c-43c2-b8f9-d3f6ef581fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:43.507428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3327003-1b9c-43c2-b8f9-d3f6ef581fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:43.512588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3327003-1b9c-43c2-b8f9-d3f6ef581fb8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:43.519739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 601/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:43.525768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:43.577742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:43.624727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878bf03-c67b-49bc-9bab-6d3915933de1 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:43.658756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a154728-91a8-4636-85a8-65b28c63bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:43.659421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154728-91a8-4636-85a8-65b28c63bfad None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:43.659704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154728-91a8-4636-85a8-65b28c63bfad None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:43.659980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154728-91a8-4636-85a8-65b28c63bfad None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:43.660725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a154728-91a8-4636-85a8-65b28c63bfad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:43.662350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a154728-91a8-4636-85a8-65b28c63bfad None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:43.736947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 604/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 22 08:45:43 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:45:45.814574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd88c5-cee4-4863-8fcc-d18e6e2062eb None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:45.815144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd88c5-cee4-4863-8fcc-d18e6e2062eb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:45.815144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd88c5-cee4-4863-8fcc-d18e6e2062eb None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:45.816505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 602/1206] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:45:45.822154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b321c-0cf2-490f-9db0-f2d173c0da34 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:45.822617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b321c-0cf2-490f-9db0-f2d173c0da34 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:45.822715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b321c-0cf2-490f-9db0-f2d173c0da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:45.840015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-487b321c-0cf2-490f-9db0-f2d173c0da34 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:45:45.841280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-487b321c-0cf2-490f-9db0-f2d173c0da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:45:45.907424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 605/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:45:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:45:45.931549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd88c5-cee4-4863-8fcc-d18e6e2062eb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:46.045162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd88c5-cee4-4863-8fcc-d18e6e2062eb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:46.078431 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c1b8-a5a3-41db-a2a5-3b73723f992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:46.079157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c1b8-a5a3-41db-a2a5-3b73723f992a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:46.079440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c1b8-a5a3-41db-a2a5-3b73723f992a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:46.079715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c1b8-a5a3-41db-a2a5-3b73723f992a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:46.090494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670c1b8-a5a3-41db-a2a5-3b73723f992a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6670c1b8-a5a3-41db-a2a5-3b73723f992a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:45:46.098101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:46.101006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:46.102116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 603/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:45:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:46.106653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b321c-0cf2-490f-9db0-f2d173c0da34 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:46.150429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:46.216339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b321c-0cf2-490f-9db0-f2d173c0da34 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:46.249990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:46.250674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:46.250963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:46.251233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:46.251975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:46.252283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:46.253635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:46.262494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 606/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:45:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:46.268249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c1b8-a5a3-41db-a2a5-3b73723f992a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:46.323539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:46.374700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c1b8-a5a3-41db-a2a5-3b73723f992a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:46.409375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:46.410279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:46.410566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:46.410847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:46.421304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:46.422746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:46.440167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:46.444042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:46.445065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:46.445065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:46.445065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:46.445065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:46.445065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 604/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:46.447634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:46.541715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:46.544655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c3710-d0bd-4991-b4fc-e5316b1267ac None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:46.577837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:46.578540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:46.578821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:46.579094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:46.579808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:46.580109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:46.581443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:46.593191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 607/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:46.598927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:46.700738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b843444-dc98-4dde-9c44-ca8925e0c26e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:46.702186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:46.738683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:46.739489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:46.739810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:46.740310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:46.748030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:46.749462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:45:46.766449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:46.767602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:46.773305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 605/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:46.774946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:46.882387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1506a8-c997-405f-a578-22bb5f357b31 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:46.916069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:46.916734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:46.917044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:46.917319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:46.918179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:46.918489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:46.920066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:46.937942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 608/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 22 08:45:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:46.944597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:47.049281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d720e-9c02-4ed0-94a2-ac5896515b38 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:47.088964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a97ad-f12c-4566-92ce-329aa6c86028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:47.089615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a97ad-f12c-4566-92ce-329aa6c86028 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:47.089896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a97ad-f12c-4566-92ce-329aa6c86028 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:47.090229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a97ad-f12c-4566-92ce-329aa6c86028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:47.121545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:47.165329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a97ad-f12c-4566-92ce-329aa6c86028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:47.167132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a97ad-f12c-4566-92ce-329aa6c86028 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:47.288958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 606/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:45:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:45:47.290281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:47.311643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:47.406465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482169-07be-423e-a5f8-9cd09ee41643 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:47.446737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:47.447544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:47.447825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:47.448121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:47.459514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:47.460964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:47.478582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:47.479553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:47.480465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:47.480465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:47.480465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:47.480465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:47.480465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 609/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:47.485473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a97ad-f12c-4566-92ce-329aa6c86028 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:47.547431 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:47.586857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a97ad-f12c-4566-92ce-329aa6c86028 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:47.620990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:47.621648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:47.621929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:47.622237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:47.622994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:47.623298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:47.624641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:47.637458 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 607/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:47.643126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:47.712873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:47.742678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2a341-bcce-48c9-bfe6-ac76d72203d7 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:47.778737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:47.779521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:47.779799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:47.780067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:47.786611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:47.789214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:45:47.802642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:47.803771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:47.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 610/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:47.809815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:47.910897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e68048-823e-4bc3-ab99-4aa804c9bb9b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:47.932839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:47.944609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d87d3b-e8ee-459f-b0b0-f388e63ddd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:47.945262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87d3b-e8ee-459f-b0b0-f388e63ddd39 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:47.945546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87d3b-e8ee-459f-b0b0-f388e63ddd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:47.945831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87d3b-e8ee-459f-b0b0-f388e63ddd39 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:47.946639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d87d3b-e8ee-459f-b0b0-f388e63ddd39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:47.946954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d87d3b-e8ee-459f-b0b0-f388e63ddd39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:47.948373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d87d3b-e8ee-459f-b0b0-f388e63ddd39 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:47.959971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 608/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:45:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:47.966191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:48.064888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf804f12-2540-4970-ab10-1f8d8b0b71cc None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:48.092977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:48.098634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95c16f-d8a2-4fd2-a193-a79b8a4b0859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:48.099474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c16f-d8a2-4fd2-a193-a79b8a4b0859 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:48.099845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c16f-d8a2-4fd2-a193-a79b8a4b0859 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:48.100126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c16f-d8a2-4fd2-a193-a79b8a4b0859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:48.100963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95c16f-d8a2-4fd2-a193-a79b8a4b0859 None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=0883944ff2a24f4fa51a7c06c3040f4d) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:48.101279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95c16f-d8a2-4fd2-a193-a79b8a4b0859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:48.102732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95c16f-d8a2-4fd2-a193-a79b8a4b0859 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:48.108518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 611/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:45:47 2022] GET /identity/v3/role_assignments?user.id=0883944ff2a24f4fa51a7c06c3040f4d&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:50.106238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcbd0-e7ec-4417-ba4d-8398f1cb6e59 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:50.106767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcbd0-e7ec-4417-ba4d-8398f1cb6e59 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:50.106767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcbd0-e7ec-4417-ba4d-8398f1cb6e59 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:50.108109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 609/1220] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:45:50.113432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bcd20-2737-44f8-bd59-bd3071e65413 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:50.115467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bcd20-2737-44f8-bd59-bd3071e65413 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:50.115467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bcd20-2737-44f8-bd59-bd3071e65413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:50.131677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0c6bcd20-2737-44f8-bd59-bd3071e65413 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:45:50.132887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0c6bcd20-2737-44f8-bd59-bd3071e65413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:45:50.198217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 612/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:45:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 08:45:50.221654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdcbd0-e7ec-4417-ba4d-8398f1cb6e59 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:50.325222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdcbd0-e7ec-4417-ba4d-8398f1cb6e59 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:50.359429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51e0d5-59ad-442a-9696-7c1e48633d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:50.360151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e0d5-59ad-442a-9696-7c1e48633d6a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:50.360436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e0d5-59ad-442a-9696-7c1e48633d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:50.360711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51e0d5-59ad-442a-9696-7c1e48633d6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:50.371057 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51e0d5-59ad-442a-9696-7c1e48633d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-2a51e0d5-59ad-442a-9696-7c1e48633d6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:45:50.378746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:50.381909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:50.382999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 610/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:50.386769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bcd20-2737-44f8-bd59-bd3071e65413 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:50.485084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bcd20-2737-44f8-bd59-bd3071e65413 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:50.508309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:50.518879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:50.519540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:50.519823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:50.520102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:50.520839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:50.521844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:50.523225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:50.531081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 613/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:45:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:50.537517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51e0d5-59ad-442a-9696-7c1e48633d6a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:50.580252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:50.636721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51e0d5-59ad-442a-9696-7c1e48633d6a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:50.668883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:50.669665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:50.669949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:50.670254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:50.680337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:50.681763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:50.699946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:50.701534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:50.702513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:50.702513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:50.702513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:50.702513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:50.702513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 611/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:50.706978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:50.805680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bfc9c-1452-4f07-8a4a-6374e6e3bbc9 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:50.843452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:50.844128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:50.844411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:50.844689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:50.845409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:50.845732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:50.847192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:50.858976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 614/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:50.864627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:50.957737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:50.964815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e5b4e-5777-4855-b7a6-30a6a4be06a9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:50.997411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:50.998236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:50.998520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:50.998792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:51.006313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:51.008017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:45:51.022492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:51.023586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:51.024723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 612/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:51.029545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:51.076115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:51.127612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f77e6b-6063-426a-baa7-36c554340432 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:51.160384 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:51.161040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:51.161321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:51.161699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:51.162554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:51.162861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:51.164365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:51.183370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 615/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 22 08:45:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:51.189114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:51.287424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6234-bc41-4a71-962f-6664f6126a5d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:51.321776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:51.322833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:51.323219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:51.323612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:51.334295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:51.335786 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:51.353298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:51.354257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:51.355207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:51.355207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:51.355207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:51.355207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:51.355207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 613/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:51.360554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:51.460002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543020a-c315-4126-abfd-1525a45fee7f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:51.462334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:51.492757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:51.493411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:51.493694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:51.493969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:51.494714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:51.495076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:51.496411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:51.508803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 616/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:51.514295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:51.524023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:51.616598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25a4b1-193e-48e1-b87f-c1e618d2ae96 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:51.649356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:51.650153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:51.655031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:51.655031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:51.657088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:51.658540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:45:51.672896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:51.673929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:51.675018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 614/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:51.680726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:51.777214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea8ac1-67e8-43b7-84b7-3ca9bd47fcd3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:51.809945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d4e81-576b-4e01-bd2c-106df47b6d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:51.810626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d4e81-576b-4e01-bd2c-106df47b6d85 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:51.810913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d4e81-576b-4e01-bd2c-106df47b6d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:51.811190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d4e81-576b-4e01-bd2c-106df47b6d85 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:51.811974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d4e81-576b-4e01-bd2c-106df47b6d85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:51.812281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d4e81-576b-4e01-bd2c-106df47b6d85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:51.813680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d4e81-576b-4e01-bd2c-106df47b6d85 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:51.826158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 617/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:51.832310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:51.897631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:51.931094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea986e2-d5af-4459-bade-eb80d44ff442 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:51.963833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0a194-fdd7-413a-97f7-6fbedfae57e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:51.964709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0a194-fdd7-413a-97f7-6fbedfae57e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:51.964989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0a194-fdd7-413a-97f7-6fbedfae57e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:51.965262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0a194-fdd7-413a-97f7-6fbedfae57e9 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/0883944ff2a24f4fa51a7c06c3040f4d/roles/68ca8a82d7b444d49fc01a6ad1de267b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:51.980552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0a194-fdd7-413a-97f7-6fbedfae57e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=0883944ff2a24f4fa51a7c06c3040f4d, role_id=68ca8a82d7b444d49fc01a6ad1de267b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:51.981969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0a194-fdd7-413a-97f7-6fbedfae57e9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:52.095754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 615/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:45:51 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/0883944ff2a24f4fa51a7c06c3040f4d/roles/68ca8a82d7b444d49fc01a6ad1de267b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:45:54.136656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489322b7-a77b-4705-9810-4b2a384e2949 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:54.137174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489322b7-a77b-4705-9810-4b2a384e2949 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:54.137174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489322b7-a77b-4705-9810-4b2a384e2949 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:54.138589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 618/1233] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:45:54.143902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c7e9-682c-434a-b98e-685f786e2e28 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:54.144321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c7e9-682c-434a-b98e-685f786e2e28 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:54.144452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47c7e9-682c-434a-b98e-685f786e2e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:54.161506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bf47c7e9-682c-434a-b98e-685f786e2e28 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:45:54.163185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bf47c7e9-682c-434a-b98e-685f786e2e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:45:54.228290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 616/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:45:54.251850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489322b7-a77b-4705-9810-4b2a384e2949 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:54.277232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:54.351545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489322b7-a77b-4705-9810-4b2a384e2949 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:54.384383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fd585-fd92-4ded-9a74-51ce5d70fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:54.385162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd585-fd92-4ded-9a74-51ce5d70fc3e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:54.385443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd585-fd92-4ded-9a74-51ce5d70fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:54.385714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fd585-fd92-4ded-9a74-51ce5d70fc3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:54.395499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fd585-fd92-4ded-9a74-51ce5d70fc3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b00fd585-fd92-4ded-9a74-51ce5d70fc3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:45:54.403994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:54.405175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:54.406300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 619/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 22 08:45:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:54.411476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47c7e9-682c-434a-b98e-685f786e2e28 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:54.456806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:54.508358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47c7e9-682c-434a-b98e-685f786e2e28 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:54.541888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:54.542823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:54.543426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:54.543818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:54.544569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:54.544877 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:54.546323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:54.554489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 617/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 22 08:45:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:45:54.560121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fd585-fd92-4ded-9a74-51ce5d70fc3e None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:54.644466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:54.660348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fd585-fd92-4ded-9a74-51ce5d70fc3e None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:54.691909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:54.693193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:54.693630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:54.693906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:54.704836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:54.706363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:54.724266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:54.725210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:54.726155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:54.726155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:54.726155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:54.726155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:54.726155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 620/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:54.731387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:54.831288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a51379-7f49-4ccf-9dfd-f61c8c0ee9c0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:54.842639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:54.866137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:54.866803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:54.867088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:54.867364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:54.868088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:54.868396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:54.869751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:54.882996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 618/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:54.888758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:54.987996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054859c-3605-4f4c-840b-df404cc20564 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:55.021140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:55.021942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:55.022262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:55.022544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:55.025286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:55.030323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:55.031784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:45:55.045950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:55.047217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:55.048204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 621/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:55.053746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:55.152678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45b394-6b2b-414f-9a36-bf6c2d9adc4b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:55.187587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:55.188257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:55.188539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:55.188813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:55.189649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:55.189957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:55.191409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:55.208680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 619/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 22 08:45:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:55.214498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:55.314389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e2ff2-d159-4770-bb19-c86bd37f1211 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:55.347467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5261fb-db0a-4bab-b13d-2668cdc1eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:55.348113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5261fb-db0a-4bab-b13d-2668cdc1eda3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:55.348398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5261fb-db0a-4bab-b13d-2668cdc1eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:55.348675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5261fb-db0a-4bab-b13d-2668cdc1eda3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:55.407914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:55.414191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5261fb-db0a-4bab-b13d-2668cdc1eda3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:55.415707 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5261fb-db0a-4bab-b13d-2668cdc1eda3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:55.510912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 622/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:45:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:45:55.516839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:55.543842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:55.614192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784a9f2-69ea-43a5-b9d5-e47f3f1c6b93 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:55.648602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:55.649448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:55.650032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:55.650522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:55.661261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:55.662779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:55.680592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:55.681629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:55.682912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:55.682912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:55.682912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:55.682912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:55.682912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 620/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:55.687465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5261fb-db0a-4bab-b13d-2668cdc1eda3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:55.780780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:55.786453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5261fb-db0a-4bab-b13d-2668cdc1eda3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:55.820192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:55.820899 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:55.821180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:55.821454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:55.822208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:55.822511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:55.823854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:55.835362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 623/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:55.842947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:55.920066 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:55.940532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2633d67-7c49-4505-a2ca-bf941432daa4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:55.974651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:55.975435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:55.975724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:55.976003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:55.982520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:55.983977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:45:55.998117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:55.999189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:56.000343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 621/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:56.005793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:56.106480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081ef3-c059-4796-b94b-55010a2d7b12 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:56.140456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467a6a8-7b34-4dc7-9e36-29c8560e3d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:56.141104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a6a8-7b34-4dc7-9e36-29c8560e3d5e None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:56.141385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a6a8-7b34-4dc7-9e36-29c8560e3d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:56.141656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467a6a8-7b34-4dc7-9e36-29c8560e3d5e None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:56.142469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467a6a8-7b34-4dc7-9e36-29c8560e3d5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:56.142777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467a6a8-7b34-4dc7-9e36-29c8560e3d5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:56.144180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467a6a8-7b34-4dc7-9e36-29c8560e3d5e None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:56.156365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 624/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:56.162692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:56.264953 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a38ed-fd6a-48d0-a390-bb2c4fb8008d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:56.299148 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b37ed-46ef-4cc0-bebc-8c9a15e68b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:56.299796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b37ed-46ef-4cc0-bebc-8c9a15e68b8d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:56.300080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b37ed-46ef-4cc0-bebc-8c9a15e68b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:56.300359 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b37ed-46ef-4cc0-bebc-8c9a15e68b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:56.301185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b37ed-46ef-4cc0-bebc-8c9a15e68b8d None admin] RBAC: Adding query filter params (role.id=68ca8a82d7b444d49fc01a6ad1de267b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=0883944ff2a24f4fa51a7c06c3040f4d) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:56.301502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b37ed-46ef-4cc0-bebc-8c9a15e68b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:56.303487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b37ed-46ef-4cc0-bebc-8c9a15e68b8d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:56.309306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 622/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:45:56 2022] GET /identity/v3/role_assignments?user.id=0883944ff2a24f4fa51a7c06c3040f4d&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=68ca8a82d7b444d49fc01a6ad1de267b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:58.373903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615e8f4-a97e-401b-b4d6-68957b9553a5 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:58.374454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615e8f4-a97e-401b-b4d6-68957b9553a5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:58.374601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615e8f4-a97e-401b-b4d6-68957b9553a5 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:58.375874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 625/1247] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:45:58.381860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1c7cd-ba4f-4fde-a3c0-d8b87fc0a33a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:58.382340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1c7cd-ba4f-4fde-a3c0-d8b87fc0a33a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:58.382432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1c7cd-ba4f-4fde-a3c0-d8b87fc0a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:58.387419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:58.399981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6fa1c7cd-ba4f-4fde-a3c0-d8b87fc0a33a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:45:58.401164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6fa1c7cd-ba4f-4fde-a3c0-d8b87fc0a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:45:58.466898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 623/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:45:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:45:58.490941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615e8f4-a97e-401b-b4d6-68957b9553a5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:58.509872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:58.590755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615e8f4-a97e-401b-b4d6-68957b9553a5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:58.624218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab70d3-1a75-4c8f-a55e-8f3d97b86272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:58.625009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab70d3-1a75-4c8f-a55e-8f3d97b86272 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:58.625294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab70d3-1a75-4c8f-a55e-8f3d97b86272 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:58.625566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab70d3-1a75-4c8f-a55e-8f3d97b86272 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:58.636693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab70d3-1a75-4c8f-a55e-8f3d97b86272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3bab70d3-1a75-4c8f-a55e-8f3d97b86272 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:45:58.644326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:58.645429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:58.646555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 626/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:58.651640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1c7cd-ba4f-4fde-a3c0-d8b87fc0a33a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:58.749946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1c7cd-ba4f-4fde-a3c0-d8b87fc0a33a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:58.779018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:58.783981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:58.784640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:58.784922 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:58.785204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:58.785947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:58.786406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:58.787751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:58.795597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 624/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:58.801424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab70d3-1a75-4c8f-a55e-8f3d97b86272 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:58.879819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:58.902792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab70d3-1a75-4c8f-a55e-8f3d97b86272 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:58.936476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:58.937275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:58.937562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:58.937842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:58.949136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:58.950601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:58.967503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:58.968662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:58.969572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:58.969572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:58.969572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:58.969572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:58.969572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 627/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:58.975166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:59.074042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b2aee-ec33-4605-af1f-15a478fba4b9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:59.107179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:59.107836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:59.108119 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:59.108396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:59.109116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:59.109424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:59.110801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:59.123297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 625/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:59.128878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:59.228994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e333a-3438-49e6-bdc3-1e9ae5f7d695 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:59.253673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:59.261862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:59.262693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:59.262977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:59.263253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:59.271269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:59.272687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:45:59.287413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:59.288347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:45:59.289348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 628/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:59.294467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:59.350510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:59.393507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c2130-9823-45aa-900f-61b1ac68a8aa None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:59.426816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:59.427480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:59.427771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:59.428049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:59.428912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:45:59.429226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:59.430697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:59.447370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 626/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 22 08:45:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:45:59.453257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:59.552617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa020b4-3c2b-4e3d-b9e6-5e74cd6518f3 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:59.585111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312322e6-17f6-457b-9b6c-fd5f7a5982f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:59.585754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312322e6-17f6-457b-9b6c-fd5f7a5982f0 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:59.586037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312322e6-17f6-457b-9b6c-fd5f7a5982f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:59.586347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312322e6-17f6-457b-9b6c-fd5f7a5982f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:59.641360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:59.653514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312322e6-17f6-457b-9b6c-fd5f7a5982f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:59.655024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312322e6-17f6-457b-9b6c-fd5f7a5982f0 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:59.754505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 629/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:45:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:45:59.760932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:45:59.862473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec79e1-9328-40dd-bbd6-a41264c24b37 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:45:59.877188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:45:59.898629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:45:59.899428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:45:59.899710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:45:59.899991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:45:59.909880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:45:59.912311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:45:59.930345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:45:59.932395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:45:59.933507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:45:59.933507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:45:59.933507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:45:59.933507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:45:59.933507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 627/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:45:59.937410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312322e6-17f6-457b-9b6c-fd5f7a5982f0 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:00.026277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:00.038809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312322e6-17f6-457b-9b6c-fd5f7a5982f0 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:00.072764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:00.073423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:00.073703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:00.073977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:00.074724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:00.075025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:00.076411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:00.088190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 630/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:00.094035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:00.195314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e4ea4-0ece-4513-a079-0f84fa03b70f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:00.229639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:00.230455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:00.230743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:00.231020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:00.237722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:00.239227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:46:00.253191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:00.254355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:00.255727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 628/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 08:46:00.261001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:00.359671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd28a3-c04a-414c-9caa-6cd33e5364fd None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:00.394082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb4abc-df26-4066-9484-55bd133e0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:00.394753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4abc-df26-4066-9484-55bd133e0941 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:00.395040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4abc-df26-4066-9484-55bd133e0941 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:00.395345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb4abc-df26-4066-9484-55bd133e0941 None admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:00.396717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb4abc-df26-4066-9484-55bd133e0941 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:00.397029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb4abc-df26-4066-9484-55bd133e0941 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:00.398475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb4abc-df26-4066-9484-55bd133e0941 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:00.410287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 631/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:00.416626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:00.442139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:00.513676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56255e-3300-4533-8d8b-222b5b19758a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:00.547337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ddaa8-2c32-457d-9823-18b4042d3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:00.548002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddaa8-2c32-457d-9823-18b4042d3f02 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:00.548887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddaa8-2c32-457d-9823-18b4042d3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:00.549168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ddaa8-2c32-457d-9823-18b4042d3f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:00.550000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ddaa8-2c32-457d-9823-18b4042d3f02 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=0883944ff2a24f4fa51a7c06c3040f4d) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:00.550346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ddaa8-2c32-457d-9823-18b4042d3f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:00.551894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ddaa8-2c32-457d-9823-18b4042d3f02 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:00.557391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 629/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:46:00 2022] GET /identity/v3/role_assignments?user.id=0883944ff2a24f4fa51a7c06c3040f4d&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:02.581446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535cf68-63fa-4a4d-aac9-298f30fdc1cd None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:02.581979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535cf68-63fa-4a4d-aac9-298f30fdc1cd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:02.582121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535cf68-63fa-4a4d-aac9-298f30fdc1cd None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:02.583484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 632/1261] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:02.588672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a013ae-0a38-4510-9c32-998c355043c4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:02.589099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a013ae-0a38-4510-9c32-998c355043c4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:02.589208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a013ae-0a38-4510-9c32-998c355043c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:02.606510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-61a013ae-0a38-4510-9c32-998c355043c4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:02.607700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-61a013ae-0a38-4510-9c32-998c355043c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:02.675061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 630/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:46:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:46:02.698122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535cf68-63fa-4a4d-aac9-298f30fdc1cd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:02.709266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:02.799254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535cf68-63fa-4a4d-aac9-298f30fdc1cd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:02.834486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44774d4-57b7-4a01-b97d-d034c6347d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:02.835211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44774d4-57b7-4a01-b97d-d034c6347d16 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:02.835498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44774d4-57b7-4a01-b97d-d034c6347d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:02.835774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44774d4-57b7-4a01-b97d-d034c6347d16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:02.845882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44774d4-57b7-4a01-b97d-d034c6347d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-f44774d4-57b7-4a01-b97d-d034c6347d16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:46:02.855916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:02.859031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:46:02.859890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 633/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:02.863285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a013ae-0a38-4510-9c32-998c355043c4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:02.882367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:02.961907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a013ae-0a38-4510-9c32-998c355043c4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:02.996101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:02.996760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:02.997049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:02.997323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:02.998089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:02.998407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:02.999751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:03.008887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 631/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:03.014419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44774d4-57b7-4a01-b97d-d034c6347d16 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:03.079713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:03.112731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44774d4-57b7-4a01-b97d-d034c6347d16 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:03.146417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:03.147227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:03.147506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:03.147779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:03.157822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:03.159306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:46:03.177172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:03.180273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:03.181276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:46:03.181276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:46:03.181276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:46:03.181276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:46:03.181276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 634/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:03.184277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:03.266199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:03.284698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41e05e-a755-40ca-a458-e3ec44e9af13 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:03.316800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:03.317605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:03.317838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:03.318137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:03.318848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:03.319153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:03.320489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:03.331365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 632/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:03.337625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:03.435362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45ae15-d40a-46b6-936d-04eb83a630cf None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:03.455022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:03.469975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:03.470800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:03.471081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:03.471354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:03.479725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:03.481119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:46:03.495336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:03.496484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:46:03.497570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 635/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:46:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:03.502647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:03.602461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92224238-df8a-4534-8692-189d539a02c4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:03.639255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:03.639940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:03.640206 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:03.640478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:03.641310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:03.641620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:03.643061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:03.652130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:03.659856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 633/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 22 08:46:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:03.666560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:03.766006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583af6f-3a8f-4460-953b-748cd020e2ce None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:03.799170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:03.799944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:03.800223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:03.800496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:03.811611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:03.813181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:46:03.831263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:03.832428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:03.833685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:46:03.833685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:46:03.833685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:46:03.833685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:46:03.833685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 636/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:03.838582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:03.936824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac26cd-17fe-48cf-96ea-8f14eca42b80 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:03.970490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:03.971146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:03.971419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:03.971693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:03.972397 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:03.972700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:03.974092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:03.985053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 634/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:03.991246 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:04.027952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:04.094691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a1d9a-29d8-4d8d-8dcb-492eeff09033 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:04.128154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:04.129047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:04.129560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:04.129922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:04.137816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:04.139290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:46:04.153712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:04.154826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:46:04.155835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 637/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:04.161312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:04.219408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:04.261808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b9435-b9b6-4b62-9a91-cee627ec3fd3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:04.295143 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed6603-9311-444a-97df-3762851af11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:04.295692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed6603-9311-444a-97df-3762851af11a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:04.295975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed6603-9311-444a-97df-3762851af11a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:04.296247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed6603-9311-444a-97df-3762851af11a None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:04.297023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed6603-9311-444a-97df-3762851af11a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:04.297330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed6603-9311-444a-97df-3762851af11a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:04.298768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed6603-9311-444a-97df-3762851af11a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:04.311056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 635/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:04.317077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:04.407148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:04.416071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154063b-a35a-44b6-8b23-50e8e974b467 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:04.449579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726904-69a2-4102-8def-4558009662a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:04.450506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726904-69a2-4102-8def-4558009662a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:04.450789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726904-69a2-4102-8def-4558009662a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:04.451066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726904-69a2-4102-8def-4558009662a9 None admin] PATH_INFO: `/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/0883944ff2a24f4fa51a7c06c3040f4d/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:04.453105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b726904-69a2-4102-8def-4558009662a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b6bd9582004d6d87bc1e693df518bf, user_id=0883944ff2a24f4fa51a7c06c3040f4d, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:04.454564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b726904-69a2-4102-8def-4558009662a9 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:04.563626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 638/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 22 08:46:04 2022] PUT /identity/v3/projects/00b6bd9582004d6d87bc1e693df518bf/users/0883944ff2a24f4fa51a7c06c3040f4d/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:46:06.552548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d73db-7f6f-4294-b46c-5c1c24f114e6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:06.553102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d73db-7f6f-4294-b46c-5c1c24f114e6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:06.553102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d73db-7f6f-4294-b46c-5c1c24f114e6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:06.554532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 636/1274] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:06.559732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7987-bbbb-4587-a661-844a6e5db4e6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:06.560141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7987-bbbb-4587-a661-844a6e5db4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:06.560287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da7987-bbbb-4587-a661-844a6e5db4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:06.577094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a1da7987-bbbb-4587-a661-844a6e5db4e6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:06.578316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a1da7987-bbbb-4587-a661-844a6e5db4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:06.644306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 639/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:46:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:46:06.668550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d73db-7f6f-4294-b46c-5c1c24f114e6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:06.769852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d73db-7f6f-4294-b46c-5c1c24f114e6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:06.787128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:06.803606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0003dd-f053-4da4-9bf9-01fb85c6b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:06.804329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0003dd-f053-4da4-9bf9-01fb85c6b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:06.804613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0003dd-f053-4da4-9bf9-01fb85c6b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:06.804892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0003dd-f053-4da4-9bf9-01fb85c6b4a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:06.814654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0003dd-f053-4da4-9bf9-01fb85c6b4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5e0003dd-f053-4da4-9bf9-01fb85c6b4a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 08:46:06.822986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:06.824090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:06.825265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 637/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 22 08:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:06.830158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da7987-bbbb-4587-a661-844a6e5db4e6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:06.912602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:06.931910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da7987-bbbb-4587-a661-844a6e5db4e6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:06.966257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:06.966921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:06.967201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:06.967474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:06.968218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:06.968525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:06.969895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:06.978524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 640/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 22 08:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:06.984182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0003dd-f053-4da4-9bf9-01fb85c6b4a1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:07.086730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0003dd-f053-4da4-9bf9-01fb85c6b4a1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:07.119900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:07.121376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:07.121376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:07.121376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:07.131711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:07.133128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:46:07.149880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:07.153261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:07.154424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:46:07.154424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:46:07.154424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:46:07.154424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:07.154424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 638/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:07.156878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:07.256947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a5378-e580-4dbe-8f10-113baaeb8d42 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:07.290593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:07.291253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:07.291539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:07.291817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:07.292532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:07.292838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:07.294201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:07.306204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 641/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:07.311830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:07.342127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:07.410327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1ad80-8501-496d-830c-1902327674ba None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:07.445032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:07.445822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:07.446127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:07.446409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:07.453215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:07.454992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 08:46:07.469973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:07.471114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:07.472085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 639/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:46:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:07.477679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:07.481381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:07.576056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf1c8a-350a-400b-93b9-d7e8e71f1e68 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:07.610643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:07.611236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:07.611518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:07.611794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:07.612623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:07.612936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:07.614475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:07.631822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 642/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 22 08:46:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:07.637622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:07.725752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:07.735031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37271a74-9110-4ef8-b198-46630ed9d49f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:07.768775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8032ca4-8e82-4c6b-bafa-20d23b043bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:07.769409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032ca4-8e82-4c6b-bafa-20d23b043bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:07.769695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032ca4-8e82-4c6b-bafa-20d23b043bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:07.769973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8032ca4-8e82-4c6b-bafa-20d23b043bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:07.837698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8032ca4-8e82-4c6b-bafa-20d23b043bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:07.839228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8032ca4-8e82-4c6b-bafa-20d23b043bd5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:07.927146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:07.937085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 640/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 22 08:46:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 08:46:07.943858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:08.004986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:08.042187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31c0e1-2fee-4530-941b-f82a5ef99f34 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:08.075570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:08.076348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:08.076627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:08.076896 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:08.087343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:08.088768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 08:46:08.106735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:08.107861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:08.108787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 08:46:08.108787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 08:46:08.108787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 08:46:08.108787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:46:08.108787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 643/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:08.113669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8032ca4-8e82-4c6b-bafa-20d23b043bd5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:08.213593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8032ca4-8e82-4c6b-bafa-20d23b043bd5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:08.250012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:08.250742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:08.251023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:08.251303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:08.252013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:08.252362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:08.253727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:08.266038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 641/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 22 08:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:08.271846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:08.375843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a0012-2ee8-431a-a2e4-b0f7b1fabb3a None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:08.392881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:08.414019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:08.414857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:08.415141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:08.415441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:08.423083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:08.424535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 08:46:08.441002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:08.442785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:08.443772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 08:46:08.443772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 08:46:08.443772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 08:46:08.443772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 08:46:08.443772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 08:46:08.443772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 08:46:08.443772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 08:46:08.443772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: ERROR keystone.server.flask.application Jun 22 08:46:08.446089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 644/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 22 08:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:08.452225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:08.504682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:08.557787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fefb8f-a8a6-48d5-89d2-bc5d0eb9a31b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:08.594695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94c82b-98ea-4852-97fe-c9fe1f5e2a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:08.595368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94c82b-98ea-4852-97fe-c9fe1f5e2a3a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:08.595654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94c82b-98ea-4852-97fe-c9fe1f5e2a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:08.595933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94c82b-98ea-4852-97fe-c9fe1f5e2a3a None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:08.596728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94c82b-98ea-4852-97fe-c9fe1f5e2a3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:08.597041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94c82b-98ea-4852-97fe-c9fe1f5e2a3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:08.599203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94c82b-98ea-4852-97fe-c9fe1f5e2a3a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:08.617793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 642/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 22 08:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:46:08.619356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:08.724169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d5d03-0cfa-420c-b5b3-617e47ee716f None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:08.758763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee451a-1d25-42bd-a3d9-ba15d1318407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:08.759360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee451a-1d25-42bd-a3d9-ba15d1318407 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:08.759638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee451a-1d25-42bd-a3d9-ba15d1318407 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:08.759916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee451a-1d25-42bd-a3d9-ba15d1318407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:08.760759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee451a-1d25-42bd-a3d9-ba15d1318407 None admin] RBAC: Adding query filter params (role.id=5bb1ede17a1d426089367e9741ae3c9b, scope.project.id=00b6bd9582004d6d87bc1e693df518bf, user.id=0883944ff2a24f4fa51a7c06c3040f4d) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:08.761072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee451a-1d25-42bd-a3d9-ba15d1318407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:08.762613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee451a-1d25-42bd-a3d9-ba15d1318407 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:08.769031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 645/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 22 08:46:08 2022] GET /identity/v3/role_assignments?user.id=0883944ff2a24f4fa51a7c06c3040f4d&scope.project.id=00b6bd9582004d6d87bc1e693df518bf&role.id=5bb1ede17a1d426089367e9741ae3c9b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:10.801885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a739af-c137-4d88-ace7-5c41dd736966 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:10.802490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a739af-c137-4d88-ace7-5c41dd736966 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:10.802490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a739af-c137-4d88-ace7-5c41dd736966 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:10.803829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 643/1288] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:10.809010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58bcd-d146-4bb5-8999-742ee4376595 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:10.809388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58bcd-d146-4bb5-8999-742ee4376595 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:10.809563 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58bcd-d146-4bb5-8999-742ee4376595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:10.826209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-84b58bcd-d146-4bb5-8999-742ee4376595 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:10.827398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-84b58bcd-d146-4bb5-8999-742ee4376595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:10.857578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:10.893686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 646/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:46:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:46:10.916710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a739af-c137-4d88-ace7-5c41dd736966 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:11.018335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a739af-c137-4d88-ace7-5c41dd736966 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:11.029287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:11.052134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:11.052864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:11.053152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:11.053435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:11.054114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:11.055479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:11.068543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:11.069779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:11.072808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 644/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:46:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:11.075905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b58bcd-d146-4bb5-8999-742ee4376595 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:11.172908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b58bcd-d146-4bb5-8999-742ee4376595 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:11.206878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e840ce-ac0d-4c39-ab21-324f29fc30f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:11.207536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e840ce-ac0d-4c39-ab21-324f29fc30f6 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:11.208591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e840ce-ac0d-4c39-ab21-324f29fc30f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:11.208870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e840ce-ac0d-4c39-ab21-324f29fc30f6 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:11.209565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e840ce-ac0d-4c39-ab21-324f29fc30f6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:11.209910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e840ce-ac0d-4c39-ab21-324f29fc30f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:11.211284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e840ce-ac0d-4c39-ab21-324f29fc30f6 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:11.216150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 647/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Wed Jun 22 08:46:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:11.221960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:11.323395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2a59b-54b5-4bd1-bba3-b3abe1f0d8e2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:11.355687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29779-6d15-4d17-8be1-efb15a8bbb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:11.356440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29779-6d15-4d17-8be1-efb15a8bbb01 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:11.356719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29779-6d15-4d17-8be1-efb15a8bbb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:11.356993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29779-6d15-4d17-8be1-efb15a8bbb01 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:11.357694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29779-6d15-4d17-8be1-efb15a8bbb01 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:11.357995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29779-6d15-4d17-8be1-efb15a8bbb01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:11.359363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29779-6d15-4d17-8be1-efb15a8bbb01 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:11.363884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 645/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Wed Jun 22 08:46:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:13.374755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141789e-8132-458f-818e-44e898e81e7a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:13.375341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141789e-8132-458f-818e-44e898e81e7a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:13.375341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141789e-8132-458f-818e-44e898e81e7a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:13.376795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 648/1293] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:13.382876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d306ee-2884-4ff8-81ca-54b64aee440b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:13.383316 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d306ee-2884-4ff8-81ca-54b64aee440b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:13.383555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d306ee-2884-4ff8-81ca-54b64aee440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:13.401020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-49d306ee-2884-4ff8-81ca-54b64aee440b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:13.402244 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-49d306ee-2884-4ff8-81ca-54b64aee440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:13.431676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:13.468554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 646/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:46:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:46:13.492092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141789e-8132-458f-818e-44e898e81e7a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:13.524116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:13.592486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141789e-8132-458f-818e-44e898e81e7a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:13.625890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c22b-eee7-4536-b5a7-4eeaf095e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:13.626513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c22b-eee7-4536-b5a7-4eeaf095e494 None admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:13.626792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c22b-eee7-4536-b5a7-4eeaf095e494 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:13.627064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c22b-eee7-4536-b5a7-4eeaf095e494 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:13.627775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c22b-eee7-4536-b5a7-4eeaf095e494 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:13.630308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c22b-eee7-4536-b5a7-4eeaf095e494 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:13.700473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 649/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 22 08:46:13 2022] POST /identity/v3/services => generated 246 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:46:15.729683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972452a5-a658-47e7-8119-2d4514a6e81f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:15.730271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972452a5-a658-47e7-8119-2d4514a6e81f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:15.730271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972452a5-a658-47e7-8119-2d4514a6e81f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:15.731643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 647/1296] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:15.736804 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e98a-224f-46b1-9168-fd4ece140d44 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:15.737178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e98a-224f-46b1-9168-fd4ece140d44 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:15.737354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463e98a-224f-46b1-9168-fd4ece140d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:15.754482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7463e98a-224f-46b1-9168-fd4ece140d44 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:15.755999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7463e98a-224f-46b1-9168-fd4ece140d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:15.827390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 650/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:46:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:46:15.851162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972452a5-a658-47e7-8119-2d4514a6e81f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:15.950181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972452a5-a658-47e7-8119-2d4514a6e81f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:15.984362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:15.985084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:15.985421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:15.985694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:15.986376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:15.987745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:15.999489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:16.000650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:16.001631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 648/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:46:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:16.007216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e98a-224f-46b1-9168-fd4ece140d44 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:16.025490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:16.104437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463e98a-224f-46b1-9168-fd4ece140d44 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:16.138859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:16.139513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:16.139795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:16.140069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:16.140761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:16.141062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:16.142414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:16.148208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 651/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Wed Jun 22 08:46:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:16.154217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:16.185005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:16.252303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a8bb-9ecf-4c44-867d-fd9420669073 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:16.286618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c5475-ecea-4105-aacb-6ce580cd5036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:16.287265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5475-ecea-4105-aacb-6ce580cd5036 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:16.287550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5475-ecea-4105-aacb-6ce580cd5036 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:16.287823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c5475-ecea-4105-aacb-6ce580cd5036 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:16.288601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c5475-ecea-4105-aacb-6ce580cd5036 None admin] RBAC: Adding query filter params (interface=public, service_id=4b7b9cdaacfa496288f2290b941cdc0a, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:16.288911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c5475-ecea-4105-aacb-6ce580cd5036 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:16.290278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c5475-ecea-4105-aacb-6ce580cd5036 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:16.295263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 649/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 22 08:46:16 2022] GET /identity/v3/endpoints?service_id=4b7b9cdaacfa496288f2290b941cdc0a&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:46:16.300978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:16.383980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:16.401830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf650-eabe-428f-85da-5e5024d03148 None admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:16.437272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0fb41-b0b1-4bc8-81d6-37687329a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:16.437957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0fb41-b0b1-4bc8-81d6-37687329a879 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:16.438319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0fb41-b0b1-4bc8-81d6-37687329a879 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:16.438595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0fb41-b0b1-4bc8-81d6-37687329a879 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:16.439266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0fb41-b0b1-4bc8-81d6-37687329a879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:16.440598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0fb41-b0b1-4bc8-81d6-37687329a879 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:16.448162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 652/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 22 08:46:16 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 08:46:18.497608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07da1e-c230-4dd7-852e-d8f9c1e58f75 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:18.498196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07da1e-c230-4dd7-852e-d8f9c1e58f75 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:18.498196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07da1e-c230-4dd7-852e-d8f9c1e58f75 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:18.499574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 650/1302] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:46:18.504968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e162-3a03-4184-a332-26eef4a67313 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:18.505603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e162-3a03-4184-a332-26eef4a67313 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:18.505833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e162-3a03-4184-a332-26eef4a67313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:18.521802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-aa92e162-3a03-4184-a332-26eef4a67313 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:46:18.523006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aa92e162-3a03-4184-a332-26eef4a67313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:46:18.588775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 653/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:46:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 08:46:18.612155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07da1e-c230-4dd7-852e-d8f9c1e58f75 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:18.707838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:18.715795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07da1e-c230-4dd7-852e-d8f9c1e58f75 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:18.748003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:18.748736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:18.749019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:18.749293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:18.749945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:18.751331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 08:46:18.763299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 08:46:18.770673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jun 22 08:46:18.771737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 651/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 22 08:46:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 08:46:18.772727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e162-3a03-4184-a332-26eef4a67313 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:18.846626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:18.869144 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e162-3a03-4184-a332-26eef4a67313 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:18.903393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f439d8-1eff-40ec-b16b-36cd06d2ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:18.904051 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f439d8-1eff-40ec-b16b-36cd06d2ab39 None admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:18.904335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f439d8-1eff-40ec-b16b-36cd06d2ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:18.904613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f439d8-1eff-40ec-b16b-36cd06d2ab39 None admin] PATH_INFO: `/v3/services` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:18.905318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f439d8-1eff-40ec-b16b-36cd06d2ab39 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:46:18.905627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f439d8-1eff-40ec-b16b-36cd06d2ab39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:18.907089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f439d8-1eff-40ec-b16b-36cd06d2ab39 None admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:18.912820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 654/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Wed Jun 22 08:46:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 08:46:18.918855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:46:19.018139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b87f8-3a60-41e2-8459-1046d2392fdf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:46:19.051447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d52ba-ac61-429f-af83-611605d96ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:46:19.052095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d52ba-ac61-429f-af83-611605d96ca6 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:46:19.059962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d52ba-ac61-429f-af83-611605d96ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:46:19.059962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d52ba-ac61-429f-af83-611605d96ca6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:46:19.059962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d52ba-ac61-429f-af83-611605d96ca6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:46:19.059962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d52ba-ac61-429f-af83-611605d96ca6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:46:19.136482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 652/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 22 08:46:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:46:28.909059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=30 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:46:29.132084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:16.254973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd1e7-3604-4aa7-aa91-a9ff8454509a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:16.255538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd1e7-3604-4aa7-aa91-a9ff8454509a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:16.255632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd1e7-3604-4aa7-aa91-a9ff8454509a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:16.257175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 655/1307] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:16.262508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09e8b-e2f6-44b4-9106-6a20a64793f5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:16.262977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09e8b-e2f6-44b4-9106-6a20a64793f5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:16.263072 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09e8b-e2f6-44b4-9106-6a20a64793f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:16.339913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cda09e8b-e2f6-44b4-9106-6a20a64793f5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:16.341197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cda09e8b-e2f6-44b4-9106-6a20a64793f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:16.466649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 653/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:16.541074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8f6b-11ed-4e13-b808-c3184036d69f None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:16.541478 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8f6b-11ed-4e13-b808-c3184036d69f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:16.541909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8f6b-11ed-4e13-b808-c3184036d69f None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:16.543776 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 656/1309] 10.222.0.36 () {54 vars in 964 bytes} [Wed Jun 22 08:52:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:16.554645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44152-a2a9-49b4-a1df-713e7d06716d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:16.554873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44152-a2a9-49b4-a1df-713e7d06716d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:16.555350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44152-a2a9-49b4-a1df-713e7d06716d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:16.662948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4af44152-a2a9-49b4-a1df-713e7d06716d None None] MFA Rules not processed for user `04a07eaeae594cc99cc07da7a4fc6b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:16.665649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4af44152-a2a9-49b4-a1df-713e7d06716d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:16.695293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:16.804821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 654/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Wed Jun 22 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:16.814467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac8f6b-11ed-4e13-b808-c3184036d69f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:16.816244 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e0ac8f6b-11ed-4e13-b808-c3184036d69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:17.000272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac8f6b-11ed-4e13-b808-c3184036d69f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:17.096575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7d675-8574-4d68-94d2-802729358665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:17.097234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d675-8574-4d68-94d2-802729358665 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:17.097519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d675-8574-4d68-94d2-802729358665 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:17.097842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d675-8574-4d68-94d2-802729358665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:17.099976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-17f7d675-8574-4d68-94d2-802729358665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:17.172474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:17.237017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d675-8574-4d68-94d2-802729358665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:17.239467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d675-8574-4d68-94d2-802729358665 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:17.261824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 657/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:19.657162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23412d1d-b41f-43f7-8050-408002b196b2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:19.657711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23412d1d-b41f-43f7-8050-408002b196b2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:19.657711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23412d1d-b41f-43f7-8050-408002b196b2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:19.659126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 655/1312] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:19.665102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62149e0-fc54-41e6-8c6d-f57de887d604 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:19.665571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62149e0-fc54-41e6-8c6d-f57de887d604 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:19.665791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62149e0-fc54-41e6-8c6d-f57de887d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:19.745633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b62149e0-fc54-41e6-8c6d-f57de887d604 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:19.746870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b62149e0-fc54-41e6-8c6d-f57de887d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:19.856203 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 658/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:19.896483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23412d1d-b41f-43f7-8050-408002b196b2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:19.898022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-23412d1d-b41f-43f7-8050-408002b196b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:20.002436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23412d1d-b41f-43f7-8050-408002b196b2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:20.076805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:20.079408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca04c-4c5d-4595-a11e-455a089663b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:20.080057 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca04c-4c5d-4595-a11e-455a089663b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:20.080341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca04c-4c5d-4595-a11e-455a089663b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:20.080617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca04c-4c5d-4595-a11e-455a089663b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:20.082446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cbaca04c-4c5d-4595-a11e-455a089663b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:20.198732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca04c-4c5d-4595-a11e-455a089663b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:20.200211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca04c-4c5d-4595-a11e-455a089663b0 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:20.218497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 656/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:22.755174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d58bf-5351-4fdd-932e-baef4298fdad None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:22.755715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d58bf-5351-4fdd-932e-baef4298fdad None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:22.755715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d58bf-5351-4fdd-932e-baef4298fdad None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:22.757099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 659/1315] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:22.762423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb199a-d92c-4d5b-be46-0b5010a73903 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:22.762838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb199a-d92c-4d5b-be46-0b5010a73903 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:22.762981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb199a-d92c-4d5b-be46-0b5010a73903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:22.826523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f3eb199a-d92c-4d5b-be46-0b5010a73903 None None] MFA Rules not processed for user `777ddb4ee44846a8a21b1b6089e99c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:22.827711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f3eb199a-d92c-4d5b-be46-0b5010a73903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:22.879139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:22.922430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 657/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:22.962001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d58bf-5351-4fdd-932e-baef4298fdad None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:22.963583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c24d58bf-5351-4fdd-932e-baef4298fdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:22.973779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:23.068401 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d58bf-5351-4fdd-932e-baef4298fdad None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:23.140541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb06363-5bb9-4974-82ad-0bace52e3b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:23.141181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb06363-5bb9-4974-82ad-0bace52e3b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:23.141460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb06363-5bb9-4974-82ad-0bace52e3b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:23.141733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb06363-5bb9-4974-82ad-0bace52e3b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:23.143399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ccb06363-5bb9-4974-82ad-0bace52e3b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:23.205286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:23.257017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb06363-5bb9-4974-82ad-0bace52e3b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:23.258472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb06363-5bb9-4974-82ad-0bace52e3b09 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:23.277022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 660/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:26.060863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663237-cfde-4ab8-a596-a2b307ec4fb9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.061424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663237-cfde-4ab8-a596-a2b307ec4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.061424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663237-cfde-4ab8-a596-a2b307ec4fb9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.062816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 658/1318] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:26.068584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167d6b-61e1-477f-bf6f-d11b5b640034 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.068988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167d6b-61e1-477f-bf6f-d11b5b640034 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.069142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167d6b-61e1-477f-bf6f-d11b5b640034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.132418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-82167d6b-61e1-477f-bf6f-d11b5b640034 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:26.133539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-82167d6b-61e1-477f-bf6f-d11b5b640034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:26.228587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 661/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:26.280907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fb2db-08ff-4e33-a639-5e7bdb6ce0fc None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.281202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fb2db-08ff-4e33-a639-5e7bdb6ce0fc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.281512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fb2db-08ff-4e33-a639-5e7bdb6ce0fc None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.282908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 659/1320] 10.222.0.36 () {54 vars in 964 bytes} [Wed Jun 22 08:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:26.288522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834bd5c-0542-4c4f-8930-15db513cbb71 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.288816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834bd5c-0542-4c4f-8930-15db513cbb71 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.289096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834bd5c-0542-4c4f-8930-15db513cbb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.309826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:26.362214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4834bd5c-0542-4c4f-8930-15db513cbb71 None None] MFA Rules not processed for user `04a07eaeae594cc99cc07da7a4fc6b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:26.363931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4834bd5c-0542-4c4f-8930-15db513cbb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:26.438116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 662/1321] 10.222.0.36 () {58 vars in 1061 bytes} [Wed Jun 22 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:26.447906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fb2db-08ff-4e33-a639-5e7bdb6ce0fc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:26.449423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-160fb2db-08ff-4e33-a639-5e7bdb6ce0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:26.552750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fb2db-08ff-4e33-a639-5e7bdb6ce0fc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:26.624656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736107e1-da66-485c-bbb6-44756a3a073f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:26.625302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736107e1-da66-485c-bbb6-44756a3a073f service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:26.625591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736107e1-da66-485c-bbb6-44756a3a073f service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:26.626167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736107e1-da66-485c-bbb6-44756a3a073f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:26.627835 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-736107e1-da66-485c-bbb6-44756a3a073f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:26.635201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:26.735229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736107e1-da66-485c-bbb6-44756a3a073f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:26.736665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736107e1-da66-485c-bbb6-44756a3a073f service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:26.755509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 660/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:30.225448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f75b28-3fcb-4d0e-9d12-cdaafe35aeda None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:30.225986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f75b28-3fcb-4d0e-9d12-cdaafe35aeda None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:30.226180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f75b28-3fcb-4d0e-9d12-cdaafe35aeda None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:30.227703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 663/1323] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:30.233573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f76bc7-9cb5-43fc-aa2c-87cc5f5733b4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:30.233994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f76bc7-9cb5-43fc-aa2c-87cc5f5733b4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:30.234184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f76bc7-9cb5-43fc-aa2c-87cc5f5733b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:30.301251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-25f76bc7-9cb5-43fc-aa2c-87cc5f5733b4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:30.302460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-25f76bc7-9cb5-43fc-aa2c-87cc5f5733b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:30.361003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:30.401060 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 661/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:30.436975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f75b28-3fcb-4d0e-9d12-cdaafe35aeda None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:30.438574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c0f75b28-3fcb-4d0e-9d12-cdaafe35aeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:30.555749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f75b28-3fcb-4d0e-9d12-cdaafe35aeda None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:30.570030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:30.637606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bfabe-bec9-40bf-aa0c-0f5fcfc8b209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:30.638308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfabe-bec9-40bf-aa0c-0f5fcfc8b209 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:30.638590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfabe-bec9-40bf-aa0c-0f5fcfc8b209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:30.638863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfabe-bec9-40bf-aa0c-0f5fcfc8b209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:30.640571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-117bfabe-bec9-40bf-aa0c-0f5fcfc8b209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:30.754714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bfabe-bec9-40bf-aa0c-0f5fcfc8b209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:30.756237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bfabe-bec9-40bf-aa0c-0f5fcfc8b209 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:30.774978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 664/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:32.866483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68337-650c-4509-af03-e59e7281da88 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:32.866968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68337-650c-4509-af03-e59e7281da88 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:32.867085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae68337-650c-4509-af03-e59e7281da88 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:32.868409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 662/1326] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:32.873719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe47f84-ffba-4da9-86eb-0f56aff13b88 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:32.874178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe47f84-ffba-4da9-86eb-0f56aff13b88 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:32.874315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe47f84-ffba-4da9-86eb-0f56aff13b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:32.921549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:32.939689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-afe47f84-ffba-4da9-86eb-0f56aff13b88 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:32.940900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-afe47f84-ffba-4da9-86eb-0f56aff13b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:33.036831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 665/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:33.073442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae68337-650c-4509-af03-e59e7281da88 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:33.075079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1ae68337-650c-4509-af03-e59e7281da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:33.177970 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae68337-650c-4509-af03-e59e7281da88 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:33.251925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37f9c1-b7a5-4b44-b20d-d09b602147b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:33.252573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f9c1-b7a5-4b44-b20d-d09b602147b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:33.252860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f9c1-b7a5-4b44-b20d-d09b602147b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:33.253139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f9c1-b7a5-4b44-b20d-d09b602147b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:33.255540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cd37f9c1-b7a5-4b44-b20d-d09b602147b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:33.272089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:33.366703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37f9c1-b7a5-4b44-b20d-d09b602147b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:33.368146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37f9c1-b7a5-4b44-b20d-d09b602147b4 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:33.387849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 663/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:35.480003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244ba93-9608-4f2f-bf2b-104fac286fc3 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:35.480597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244ba93-9608-4f2f-bf2b-104fac286fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:35.480597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244ba93-9608-4f2f-bf2b-104fac286fc3 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:35.481961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 666/1329] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:35.487448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6342-c6af-419d-b9eb-0b7423df33a2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:35.488438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6342-c6af-419d-b9eb-0b7423df33a2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:35.488582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6342-c6af-419d-b9eb-0b7423df33a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:35.562110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d00e6342-c6af-419d-b9eb-0b7423df33a2 None None] MFA Rules not processed for user `777ddb4ee44846a8a21b1b6089e99c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:35.563354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d00e6342-c6af-419d-b9eb-0b7423df33a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:35.631965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:35.665652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 664/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:35.702096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244ba93-9608-4f2f-bf2b-104fac286fc3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:35.703667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c244ba93-9608-4f2f-bf2b-104fac286fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:35.809788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244ba93-9608-4f2f-bf2b-104fac286fc3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:35.833524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:35.888805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a4e94-e24d-4781-a8b7-007495ee1884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:35.889453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a4e94-e24d-4781-a8b7-007495ee1884 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:35.889737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a4e94-e24d-4781-a8b7-007495ee1884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:35.890012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a4e94-e24d-4781-a8b7-007495ee1884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:35.891690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-458a4e94-e24d-4781-a8b7-007495ee1884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:36.004624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a4e94-e24d-4781-a8b7-007495ee1884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:36.006014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a4e94-e24d-4781-a8b7-007495ee1884 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:36.024847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 667/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:38.538343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a63f-1674-4caa-b296-f4e08d206b10 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:38.538874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a63f-1674-4caa-b296-f4e08d206b10 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:38.538874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a63f-1674-4caa-b296-f4e08d206b10 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:38.540248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 665/1332] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:38.545398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb18a2-e8c1-490d-b770-f6d459b83bfe None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:38.545785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb18a2-e8c1-490d-b770-f6d459b83bfe None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:38.546048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb18a2-e8c1-490d-b770-f6d459b83bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:38.609298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:38.612149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-93eb18a2-e8c1-490d-b770-f6d459b83bfe None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:38.613676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-93eb18a2-e8c1-490d-b770-f6d459b83bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:38.711777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 668/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:38.748340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a63f-1674-4caa-b296-f4e08d206b10 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:38.749952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3d71a63f-1674-4caa-b296-f4e08d206b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:38.854570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a63f-1674-4caa-b296-f4e08d206b10 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:38.926980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae96df-358e-4bce-abb8-cd147eb90752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:38.927623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae96df-358e-4bce-abb8-cd147eb90752 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:38.927909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae96df-358e-4bce-abb8-cd147eb90752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:38.928177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae96df-358e-4bce-abb8-cd147eb90752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:38.929822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8cae96df-358e-4bce-abb8-cd147eb90752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:38.957139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:39.036446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae96df-358e-4bce-abb8-cd147eb90752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:39.037979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae96df-358e-4bce-abb8-cd147eb90752 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:39.057470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 666/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:41.126956 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b9a9-5c09-4da9-b955-c5030779e595 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:41.127484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b9a9-5c09-4da9-b955-c5030779e595 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:41.127484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4b9a9-5c09-4da9-b955-c5030779e595 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:41.129380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 669/1335] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:41.134680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe19cc-8a9e-41da-b782-167c9acc80ad None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:41.135353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe19cc-8a9e-41da-b782-167c9acc80ad None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:41.135606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe19cc-8a9e-41da-b782-167c9acc80ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:41.199110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-54fe19cc-8a9e-41da-b782-167c9acc80ad None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:41.200290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-54fe19cc-8a9e-41da-b782-167c9acc80ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:41.274224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:41.294847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 667/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:41.335097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b9a9-5c09-4da9-b955-c5030779e595 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:41.336662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-89b4b9a9-5c09-4da9-b955-c5030779e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:41.437583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4b9a9-5c09-4da9-b955-c5030779e595 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:41.466400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:41.512521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0459323-b931-48b7-840e-7383cd011079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:41.513165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0459323-b931-48b7-840e-7383cd011079 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:41.513450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0459323-b931-48b7-840e-7383cd011079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:41.513724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0459323-b931-48b7-840e-7383cd011079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:41.515408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b0459323-b931-48b7-840e-7383cd011079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:41.621738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0459323-b931-48b7-840e-7383cd011079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:41.623188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0459323-b931-48b7-840e-7383cd011079 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:41.640912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 670/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:44.222501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b59264-f6c7-4f2c-a44b-1d544a58bca4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:44.223016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b59264-f6c7-4f2c-a44b-1d544a58bca4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:44.223136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b59264-f6c7-4f2c-a44b-1d544a58bca4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:44.224423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 668/1338] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:44.230232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef306-9de4-4ee0-83a1-28bffb05ab28 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:44.230679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef306-9de4-4ee0-83a1-28bffb05ab28 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:44.230782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ef306-9de4-4ee0-83a1-28bffb05ab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:44.297317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f51ef306-9de4-4ee0-83a1-28bffb05ab28 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:44.298568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f51ef306-9de4-4ee0-83a1-28bffb05ab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:44.307125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:44.398594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 671/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:44.436183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b59264-f6c7-4f2c-a44b-1d544a58bca4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:44.437760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a3b59264-f6c7-4f2c-a44b-1d544a58bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:44.542450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b59264-f6c7-4f2c-a44b-1d544a58bca4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:44.614435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884ecf2-9df7-4645-8085-eadde23e4291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:44.615084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ecf2-9df7-4645-8085-eadde23e4291 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:44.615373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ecf2-9df7-4645-8085-eadde23e4291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:44.615654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884ecf2-9df7-4645-8085-eadde23e4291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:44.617312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1884ecf2-9df7-4645-8085-eadde23e4291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:44.653388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:44.725392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ecf2-9df7-4645-8085-eadde23e4291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:44.727015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884ecf2-9df7-4645-8085-eadde23e4291 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:44.745571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 669/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:48.952514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d70f3e-0663-465f-a91c-42d5077259ff None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:48.953053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d70f3e-0663-465f-a91c-42d5077259ff None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:48.953053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d70f3e-0663-465f-a91c-42d5077259ff None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:48.957686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 672/1341] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:48.960548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe173db-3470-40c8-b760-864343c53e82 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:48.961030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe173db-3470-40c8-b760-864343c53e82 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:48.961121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe173db-3470-40c8-b760-864343c53e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:49.045409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7fe173db-3470-40c8-b760-864343c53e82 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:49.046648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7fe173db-3470-40c8-b760-864343c53e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:49.147381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:49.160878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 670/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:49.202874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d70f3e-0663-465f-a91c-42d5077259ff None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:49.205334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-50d70f3e-0663-465f-a91c-42d5077259ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:49.306259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d70f3e-0663-465f-a91c-42d5077259ff None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:49.310181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d10fa3-d539-4969-88e7-b8a518d596fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:49.310829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10fa3-d539-4969-88e7-b8a518d596fb service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:49.311109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10fa3-d539-4969-88e7-b8a518d596fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:49.311382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10fa3-d539-4969-88e7-b8a518d596fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:49.322332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d10fa3-d539-4969-88e7-b8a518d596fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:49.323760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d10fa3-d539-4969-88e7-b8a518d596fb service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:49.333849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 673/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:52.322088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdae19-be1a-49b5-aa4a-d948b5515e93 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:52.322670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdae19-be1a-49b5-aa4a-d948b5515e93 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:52.322670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdae19-be1a-49b5-aa4a-d948b5515e93 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:52.324201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 671/1344] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:52.329712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a451c8-47aa-4dd4-9dfa-a5fe54ee2858 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:52.330287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a451c8-47aa-4dd4-9dfa-a5fe54ee2858 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:52.330287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a451c8-47aa-4dd4-9dfa-a5fe54ee2858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:52.361006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e9a451c8-47aa-4dd4-9dfa-a5fe54ee2858 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:52.362426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e9a451c8-47aa-4dd4-9dfa-a5fe54ee2858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:52.392449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:52:52.445890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 674/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:52.485933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdae19-be1a-49b5-aa4a-d948b5515e93 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:52.497488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdae19-be1a-49b5-aa4a-d948b5515e93 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:52.501492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830e3c6-6118-4cbc-aa62-47562d544cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:52.502222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e3c6-6118-4cbc-aa62-47562d544cea service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:52.502504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e3c6-6118-4cbc-aa62-47562d544cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:52.503357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830e3c6-6118-4cbc-aa62-47562d544cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:52.513273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830e3c6-6118-4cbc-aa62-47562d544cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:52.514751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830e3c6-6118-4cbc-aa62-47562d544cea service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:52.525388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 672/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:52:56.851703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5f8d-9b20-4ab7-9f24-8e3a21c2ad05 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:56.852193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5f8d-9b20-4ab7-9f24-8e3a21c2ad05 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:56.852284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb5f8d-9b20-4ab7-9f24-8e3a21c2ad05 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:56.853781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 675/1347] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:52:56.858963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca554-cd73-431a-9e41-dbb5ddf5763f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:56.859448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca554-cd73-431a-9e41-dbb5ddf5763f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:56.866284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca554-cd73-431a-9e41-dbb5ddf5763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:56.879520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f63ca554-cd73-431a-9e41-dbb5ddf5763f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:52:56.880720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f63ca554-cd73-431a-9e41-dbb5ddf5763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:56.890754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 673/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:52:56.931070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb5f8d-9b20-4ab7-9f24-8e3a21c2ad05 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:52:56.932821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fefb5f8d-9b20-4ab7-9f24-8e3a21c2ad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:52:56.946513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb5f8d-9b20-4ab7-9f24-8e3a21c2ad05 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:52:56.950166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dbd6e-98ce-47c4-b415-27f5515d0faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:52:56.950815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dbd6e-98ce-47c4-b415-27f5515d0faf service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:52:56.951100 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dbd6e-98ce-47c4-b415-27f5515d0faf service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:52:56.951380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dbd6e-98ce-47c4-b415-27f5515d0faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:52:56.960515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dbd6e-98ce-47c4-b415-27f5515d0faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:52:56.961935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dbd6e-98ce-47c4-b415-27f5515d0faf service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:52:56.972192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 676/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:02.035749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f974-51f1-42d6-a21d-97238d96f0f2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:02.036689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f974-51f1-42d6-a21d-97238d96f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:02.037197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f974-51f1-42d6-a21d-97238d96f0f2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:02.039082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 674/1350] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 08:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:02.044220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c9d8-b5af-4397-9495-1669efbffa90 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:02.044626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c9d8-b5af-4397-9495-1669efbffa90 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:02.044812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26c9d8-b5af-4397-9495-1669efbffa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:02.119851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8f26c9d8-b5af-4397-9495-1669efbffa90 None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:02.122721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8f26c9d8-b5af-4397-9495-1669efbffa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:02.208313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 677/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 08:53:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:06.383419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82e5a-427c-43d4-8447-507351c8033a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:06.384111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82e5a-427c-43d4-8447-507351c8033a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:06.384111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82e5a-427c-43d4-8447-507351c8033a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:06.385631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 675/1352] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 08:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:06.390608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c662e-dbba-4ed1-809f-8b47bb772072 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:06.391071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c662e-dbba-4ed1-809f-8b47bb772072 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:06.391296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c662e-dbba-4ed1-809f-8b47bb772072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:06.410534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-df7c662e-dbba-4ed1-809f-8b47bb772072 None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:06.411730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-df7c662e-dbba-4ed1-809f-8b47bb772072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:06.420564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 678/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:06.872552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=13 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:07.976469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e07c4-69f7-4200-b0a0-8d9e498c6639 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:07.977082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e07c4-69f7-4200-b0a0-8d9e498c6639 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:07.977082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e07c4-69f7-4200-b0a0-8d9e498c6639 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:07.978562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 676/1354] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 08:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:07.983402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c38fe-7d13-4bea-a3d6-cf066322a289 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:07.983829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c38fe-7d13-4bea-a3d6-cf066322a289 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:07.983940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c38fe-7d13-4bea-a3d6-cf066322a289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:08.003611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-513c38fe-7d13-4bea-a3d6-cf066322a289 None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:08.004813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-513c38fe-7d13-4bea-a3d6-cf066322a289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:08.013665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 679/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:11.756455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337319b0-22db-4eb4-832b-bb6eb8379f7f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:11.757104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337319b0-22db-4eb4-832b-bb6eb8379f7f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:11.757290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337319b0-22db-4eb4-832b-bb6eb8379f7f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:11.759007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 677/1356] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:11.764860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697a8c-c4a6-4624-8162-1b1ff04441ab None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:11.765464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697a8c-c4a6-4624-8162-1b1ff04441ab None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:11.765890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697a8c-c4a6-4624-8162-1b1ff04441ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:11.785432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0e697a8c-c4a6-4624-8162-1b1ff04441ab None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:11.786652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0e697a8c-c4a6-4624-8162-1b1ff04441ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:11.794920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 680/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:11.855180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ac72-323e-46d8-9269-2ff76c23ffca None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:11.855725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ac72-323e-46d8-9269-2ff76c23ffca None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:11.856216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ac72-323e-46d8-9269-2ff76c23ffca None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:11.858166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 678/1358] 10.222.0.36 () {54 vars in 961 bytes} [Wed Jun 22 08:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:11.872611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162c7c-87ec-4700-978e-d9c3a29df3f3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:11.873142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162c7c-87ec-4700-978e-d9c3a29df3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:11.873647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f162c7c-87ec-4700-978e-d9c3a29df3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:11.919352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:11.927895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1f162c7c-87ec-4700-978e-d9c3a29df3f3 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:11.929163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1f162c7c-87ec-4700-978e-d9c3a29df3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:12.014855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 681/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Jun 22 08:53:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:53:12.028845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ac72-323e-46d8-9269-2ff76c23ffca None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:12.045732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ac72-323e-46d8-9269-2ff76c23ffca None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:12.051592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc90320-6b5a-42f6-9a52-67c01a018314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:12.052373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90320-6b5a-42f6-9a52-67c01a018314 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:12.052813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90320-6b5a-42f6-9a52-67c01a018314 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:12.053288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc90320-6b5a-42f6-9a52-67c01a018314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:12.063193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc90320-6b5a-42f6-9a52-67c01a018314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:12.065943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc90320-6b5a-42f6-9a52-67c01a018314 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:12.078546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 679/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:14.356949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0409-72b2-433f-83b0-95c1e6a3cab6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:14.357469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0409-72b2-433f-83b0-95c1e6a3cab6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:14.357575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c0409-72b2-433f-83b0-95c1e6a3cab6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:14.358913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 682/1361] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:14.364572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b029bc-ddb7-46fe-86fb-8bf28c0e6f69 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:14.365150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b029bc-ddb7-46fe-86fb-8bf28c0e6f69 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:14.365462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b029bc-ddb7-46fe-86fb-8bf28c0e6f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:14.384387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-87b029bc-ddb7-46fe-86fb-8bf28c0e6f69 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:14.385715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-87b029bc-ddb7-46fe-86fb-8bf28c0e6f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:14.394827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 680/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:14.442648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0409-72b2-433f-83b0-95c1e6a3cab6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:14.457581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c0409-72b2-433f-83b0-95c1e6a3cab6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:14.463095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593a5a8-7c96-4422-a33b-b9b1657a5cc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:14.463739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593a5a8-7c96-4422-a33b-b9b1657a5cc2 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:14.464023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593a5a8-7c96-4422-a33b-b9b1657a5cc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:14.464683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593a5a8-7c96-4422-a33b-b9b1657a5cc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:14.474477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593a5a8-7c96-4422-a33b-b9b1657a5cc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:14.476104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593a5a8-7c96-4422-a33b-b9b1657a5cc2 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:14.488010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 683/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:17.020643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc0c2-008f-4d95-b3eb-864bcaf46daf None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:17.021181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc0c2-008f-4d95-b3eb-864bcaf46daf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:17.021181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bc0c2-008f-4d95-b3eb-864bcaf46daf None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:17.022580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 681/1364] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:17.027952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cf1c-8bc5-4f61-ab9c-2317d548aae1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:17.028356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cf1c-8bc5-4f61-ab9c-2317d548aae1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:17.028546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25cf1c-8bc5-4f61-ab9c-2317d548aae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:17.046966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9d25cf1c-8bc5-4f61-ab9c-2317d548aae1 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:17.048202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9d25cf1c-8bc5-4f61-ab9c-2317d548aae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:17.056344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 684/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:17.105022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6237f-493e-40a7-af84-a18c84767a4a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:17.105627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6237f-493e-40a7-af84-a18c84767a4a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:17.105973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6237f-493e-40a7-af84-a18c84767a4a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:17.107515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 682/1366] 10.222.0.36 () {54 vars in 961 bytes} [Wed Jun 22 08:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:17.113244 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654b21-f379-4bbf-b866-95ef8056a692 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:17.113618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654b21-f379-4bbf-b866-95ef8056a692 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:17.113905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654b21-f379-4bbf-b866-95ef8056a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:17.132508 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e3654b21-f379-4bbf-b866-95ef8056a692 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:17.133704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e3654b21-f379-4bbf-b866-95ef8056a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:17.143934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 685/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Jun 22 08:53:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:17.151874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6237f-493e-40a7-af84-a18c84767a4a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:17.172355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6237f-493e-40a7-af84-a18c84767a4a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:17.177400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8438818-3237-44ad-a6d0-5135cbd10a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:17.178359 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8438818-3237-44ad-a6d0-5135cbd10a14 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:17.178712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8438818-3237-44ad-a6d0-5135cbd10a14 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:17.179056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8438818-3237-44ad-a6d0-5135cbd10a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:17.188006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8438818-3237-44ad-a6d0-5135cbd10a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:17.190190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8438818-3237-44ad-a6d0-5135cbd10a14 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:17.199627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 683/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:19.514584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93b563-dfe5-43f3-8a95-ecb214bd7142 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:19.515134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93b563-dfe5-43f3-8a95-ecb214bd7142 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:19.515134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93b563-dfe5-43f3-8a95-ecb214bd7142 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:19.516526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 686/1369] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:19.522020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a139f-bf1b-46a1-afa9-d9cfe5308b87 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:19.522902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a139f-bf1b-46a1-afa9-d9cfe5308b87 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:19.523336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a139f-bf1b-46a1-afa9-d9cfe5308b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:19.542254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-624a139f-bf1b-46a1-afa9-d9cfe5308b87 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:19.543688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-624a139f-bf1b-46a1-afa9-d9cfe5308b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:19.558409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 684/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:19.598444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93b563-dfe5-43f3-8a95-ecb214bd7142 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:19.616177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93b563-dfe5-43f3-8a95-ecb214bd7142 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:19.622378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628d947-8bf2-48bf-926e-a57ff43c9faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:19.623130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628d947-8bf2-48bf-926e-a57ff43c9faa service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:19.623516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628d947-8bf2-48bf-926e-a57ff43c9faa service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:19.623893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628d947-8bf2-48bf-926e-a57ff43c9faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:19.633681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628d947-8bf2-48bf-926e-a57ff43c9faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:19.635399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628d947-8bf2-48bf-926e-a57ff43c9faa service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:19.645457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 687/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:19.842774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864614-f923-4574-a017-4a38d67a1dc0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:19.843060 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864614-f923-4574-a017-4a38d67a1dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:19.843336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864614-f923-4574-a017-4a38d67a1dc0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:19.844710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 685/1372] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:19.851145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34763-ec47-477b-ae80-8bd515492e69 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:19.851438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34763-ec47-477b-ae80-8bd515492e69 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:19.851721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a34763-ec47-477b-ae80-8bd515492e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:19.872013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c2a34763-ec47-477b-ae80-8bd515492e69 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:19.873258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c2a34763-ec47-477b-ae80-8bd515492e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:19.882773 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 688/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:53:20.239129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8d8b-1cc1-4ddd-9d5f-d978415f3e39 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:20.239129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8d8b-1cc1-4ddd-9d5f-d978415f3e39 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:20.239129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd8d8b-1cc1-4ddd-9d5f-d978415f3e39 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:20.239129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 686/1374] 10.222.0.36 () {54 vars in 963 bytes} [Wed Jun 22 08:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:20.242668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae4b8-eb07-431a-b0bf-5e4fec8348c4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:20.243019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae4b8-eb07-431a-b0bf-5e4fec8348c4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:20.243364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedae4b8-eb07-431a-b0bf-5e4fec8348c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:20.296216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cedae4b8-eb07-431a-b0bf-5e4fec8348c4 None None] MFA Rules not processed for user `8b95f073ece04f57a0c27cd3f5dd00cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:20.297675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cedae4b8-eb07-431a-b0bf-5e4fec8348c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:20.363220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 689/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Jun 22 08:53:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:20.371687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd8d8b-1cc1-4ddd-9d5f-d978415f3e39 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:20.383147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd8d8b-1cc1-4ddd-9d5f-d978415f3e39 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:20.386959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02153c4-341d-4399-855c-45b8a9ad36d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:20.387697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02153c4-341d-4399-855c-45b8a9ad36d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:20.388075 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02153c4-341d-4399-855c-45b8a9ad36d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:20.388447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02153c4-341d-4399-855c-45b8a9ad36d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:20.398492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02153c4-341d-4399-855c-45b8a9ad36d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:20.400044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02153c4-341d-4399-855c-45b8a9ad36d8 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:20.410493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 687/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:21.890117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd7ac-cbe9-456a-8593-a62771d565ad None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:21.890667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd7ac-cbe9-456a-8593-a62771d565ad None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:21.890667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd7ac-cbe9-456a-8593-a62771d565ad None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:21.892068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 690/1377] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:21.897746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fb6cc-05f8-4cf0-b8a8-77600b4c57fd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:21.898209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fb6cc-05f8-4cf0-b8a8-77600b4c57fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:21.898347 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fb6cc-05f8-4cf0-b8a8-77600b4c57fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:21.916481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cc4fb6cc-05f8-4cf0-b8a8-77600b4c57fd None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:21.917771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cc4fb6cc-05f8-4cf0-b8a8-77600b4c57fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:21.926208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 688/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:21.970113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bd7ac-cbe9-456a-8593-a62771d565ad None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:21.984861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bd7ac-cbe9-456a-8593-a62771d565ad None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:21.991152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee5293-d63a-48e1-b71b-e62e1e6f0dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:21.991789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5293-d63a-48e1-b71b-e62e1e6f0dbf service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:21.992069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5293-d63a-48e1-b71b-e62e1e6f0dbf service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:21.992338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5293-d63a-48e1-b71b-e62e1e6f0dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:22.000871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5293-d63a-48e1-b71b-e62e1e6f0dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:22.002930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5293-d63a-48e1-b71b-e62e1e6f0dbf service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:22.008031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:22.015077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 691/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:24.257950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac390b-3ea8-4e98-9161-ae9aabd93312 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:24.258837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac390b-3ea8-4e98-9161-ae9aabd93312 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:24.259273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac390b-3ea8-4e98-9161-ae9aabd93312 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:24.260793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 689/1380] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:24.266099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a5726-39c6-4759-8c7f-26342dba551a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:24.266628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a5726-39c6-4759-8c7f-26342dba551a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:24.266734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a5726-39c6-4759-8c7f-26342dba551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:24.286461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-338a5726-39c6-4759-8c7f-26342dba551a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:24.287781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-338a5726-39c6-4759-8c7f-26342dba551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:24.296317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 692/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:24.341720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac390b-3ea8-4e98-9161-ae9aabd93312 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:24.358781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac390b-3ea8-4e98-9161-ae9aabd93312 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:24.364385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bbdf7-4412-4c7e-89bc-7ff00aeffd23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:24.365136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bbdf7-4412-4c7e-89bc-7ff00aeffd23 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:24.365513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bbdf7-4412-4c7e-89bc-7ff00aeffd23 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:24.365882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bbdf7-4412-4c7e-89bc-7ff00aeffd23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:24.374682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bbdf7-4412-4c7e-89bc-7ff00aeffd23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:24.376358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bbdf7-4412-4c7e-89bc-7ff00aeffd23 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:24.386494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 690/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:26.653516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb3d1-1230-447f-bc84-8cf03d5d08d0 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:26.654465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb3d1-1230-447f-bc84-8cf03d5d08d0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:26.654756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfb3d1-1230-447f-bc84-8cf03d5d08d0 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:26.656260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 693/1383] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:26.662202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ef0ce-6bee-49ac-9098-226c4a5b505f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:26.662202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ef0ce-6bee-49ac-9098-226c4a5b505f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:26.662202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ef0ce-6bee-49ac-9098-226c4a5b505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:26.680803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7c1ef0ce-6bee-49ac-9098-226c4a5b505f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:26.681999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7c1ef0ce-6bee-49ac-9098-226c4a5b505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:26.690831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 691/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:26.732293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfb3d1-1230-447f-bc84-8cf03d5d08d0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:26.747819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfb3d1-1230-447f-bc84-8cf03d5d08d0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:26.754507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95654418-cc43-48bf-a505-1bb4cb529b49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:26.755224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654418-cc43-48bf-a505-1bb4cb529b49 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:26.755527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654418-cc43-48bf-a505-1bb4cb529b49 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:26.755806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95654418-cc43-48bf-a505-1bb4cb529b49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:26.764277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95654418-cc43-48bf-a505-1bb4cb529b49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:26.765854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95654418-cc43-48bf-a505-1bb4cb529b49 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:26.775749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 694/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:28.845173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f0dab-b862-4b8e-a68c-caeb333700fd None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:28.845795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f0dab-b862-4b8e-a68c-caeb333700fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:28.846115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f0dab-b862-4b8e-a68c-caeb333700fd None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:28.847546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 692/1386] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:53:28.852654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f385d-eac6-4143-91e4-57f0ee6564f2 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:28.853066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f385d-eac6-4143-91e4-57f0ee6564f2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:28.853279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f385d-eac6-4143-91e4-57f0ee6564f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:28.872206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-892f385d-eac6-4143-91e4-57f0ee6564f2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:28.873371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-892f385d-eac6-4143-91e4-57f0ee6564f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:28.882113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 695/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:28.929229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f0dab-b862-4b8e-a68c-caeb333700fd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:28.947726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f0dab-b862-4b8e-a68c-caeb333700fd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:28.954798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685e6cb-e0ef-4a7c-a21a-f01f5851c3ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:28.955663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e6cb-e0ef-4a7c-a21a-f01f5851c3ed service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:28.956107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e6cb-e0ef-4a7c-a21a-f01f5851c3ed service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:28.956475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685e6cb-e0ef-4a7c-a21a-f01f5851c3ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:28.967117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e6cb-e0ef-4a7c-a21a-f01f5851c3ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:28.969163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685e6cb-e0ef-4a7c-a21a-f01f5851c3ed service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:28.982502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 693/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:31.482181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bee7b-fbfe-419c-8373-1bdd968f2877 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:31.482751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bee7b-fbfe-419c-8373-1bdd968f2877 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:31.482751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bee7b-fbfe-419c-8373-1bdd968f2877 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:31.484116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 696/1389] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:31.491560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126463a-3cd6-4de6-bb7c-d44a5b9116b3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:31.492000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126463a-3cd6-4de6-bb7c-d44a5b9116b3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:31.492317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126463a-3cd6-4de6-bb7c-d44a5b9116b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:31.514166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7126463a-3cd6-4de6-bb7c-d44a5b9116b3 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:31.515360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7126463a-3cd6-4de6-bb7c-d44a5b9116b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:31.523968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 694/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:31.572355 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bee7b-fbfe-419c-8373-1bdd968f2877 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:31.588412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bee7b-fbfe-419c-8373-1bdd968f2877 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:31.595318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4503b8-231d-424c-9ef2-58b34660fcc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:31.595960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4503b8-231d-424c-9ef2-58b34660fcc6 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:31.596336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4503b8-231d-424c-9ef2-58b34660fcc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:31.596611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4503b8-231d-424c-9ef2-58b34660fcc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:31.605538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4503b8-231d-424c-9ef2-58b34660fcc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:31.607304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4503b8-231d-424c-9ef2-58b34660fcc6 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:31.617364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 697/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:33.932626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01722-af21-4caa-b713-3236af91af6e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:33.933150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01722-af21-4caa-b713-3236af91af6e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:33.933284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01722-af21-4caa-b713-3236af91af6e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:33.934665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 695/1392] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:33.940104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f97b8-6c50-4f6a-a08e-6c0f44396988 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:33.940538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f97b8-6c50-4f6a-a08e-6c0f44396988 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:33.940659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f97b8-6c50-4f6a-a08e-6c0f44396988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:33.959107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c26f97b8-6c50-4f6a-a08e-6c0f44396988 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:33.960594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c26f97b8-6c50-4f6a-a08e-6c0f44396988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:33.968653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 698/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:53:34.013869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e01722-af21-4caa-b713-3236af91af6e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:34.029080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e01722-af21-4caa-b713-3236af91af6e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:34.035594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e212c04-946a-4846-9270-919b13b50478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:34.036235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e212c04-946a-4846-9270-919b13b50478 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:34.036517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e212c04-946a-4846-9270-919b13b50478 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:34.036795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e212c04-946a-4846-9270-919b13b50478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:34.045399 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e212c04-946a-4846-9270-919b13b50478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:34.047015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e212c04-946a-4846-9270-919b13b50478 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:34.057057 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 696/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:35.909042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d32d-16b4-4888-8dc9-d74604d07d7f None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:35.909632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d32d-16b4-4888-8dc9-d74604d07d7f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:35.909632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505d32d-16b4-4888-8dc9-d74604d07d7f None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:35.911000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 699/1395] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:35.916295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eca71-4924-4716-b263-f6699b6fa6d6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:35.916741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eca71-4924-4716-b263-f6699b6fa6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:35.916855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eca71-4924-4716-b263-f6699b6fa6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:35.934501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-638eca71-4924-4716-b263-f6699b6fa6d6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:35.935674 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-638eca71-4924-4716-b263-f6699b6fa6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:35.944061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 697/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:36.000421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99d459-94ca-4a4b-a67d-f894fd75e9b5 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:36.001296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99d459-94ca-4a4b-a67d-f894fd75e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:36.001767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99d459-94ca-4a4b-a67d-f894fd75e9b5 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:36.003439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 700/1397] 10.222.0.36 () {54 vars in 962 bytes} [Wed Jun 22 08:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:36.008593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e9f4-b4f6-40af-b4ee-9be3e2498298 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:36.008893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e9f4-b4f6-40af-b4ee-9be3e2498298 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:36.009222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6e9f4-b4f6-40af-b4ee-9be3e2498298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:36.058083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-eba6e9f4-b4f6-40af-b4ee-9be3e2498298 None None] MFA Rules not processed for user `bb36ac7a2e4643009bc1b0ca599203f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:36.059285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-eba6e9f4-b4f6-40af-b4ee-9be3e2498298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:36.119505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 698/1398] 10.222.0.36 () {58 vars in 1059 bytes} [Wed Jun 22 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:36.127885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99d459-94ca-4a4b-a67d-f894fd75e9b5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:36.138617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99d459-94ca-4a4b-a67d-f894fd75e9b5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:36.143116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774cff-4bee-4674-9229-7c97c9eb6a2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb36ac7a2e4643009bc1b0ca599203f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:36.143759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774cff-4bee-4674-9229-7c97c9eb6a2b service glance] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:36.144047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774cff-4bee-4674-9229-7c97c9eb6a2b service glance] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:36.144326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774cff-4bee-4674-9229-7c97c9eb6a2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:36.153289 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774cff-4bee-4674-9229-7c97c9eb6a2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:36.154724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774cff-4bee-4674-9229-7c97c9eb6a2b service glance] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:36.164783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 701/1399] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:36.268333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ddde-3c0a-4b32-8c68-faa26d2a1694 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:36.268756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ddde-3c0a-4b32-8c68-faa26d2a1694 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:36.269044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16ddde-3c0a-4b32-8c68-faa26d2a1694 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:36.270454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 699/1400] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:36.275783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0ecf-75f1-4a29-a647-066ea7cd7ed1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:36.276139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0ecf-75f1-4a29-a647-066ea7cd7ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:36.276484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0ecf-75f1-4a29-a647-066ea7cd7ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:36.294666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a9ee0ecf-75f1-4a29-a647-066ea7cd7ed1 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:36.295975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a9ee0ecf-75f1-4a29-a647-066ea7cd7ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:36.305913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 702/1401] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:36.351298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ddde-3c0a-4b32-8c68-faa26d2a1694 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:36.366829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16ddde-3c0a-4b32-8c68-faa26d2a1694 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:36.372509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e200-9242-4641-b1b0-9da484bc90ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:36.373098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e200-9242-4641-b1b0-9da484bc90ea service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:36.373379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e200-9242-4641-b1b0-9da484bc90ea service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:36.373654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e200-9242-4641-b1b0-9da484bc90ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:36.383861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e200-9242-4641-b1b0-9da484bc90ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:36.385494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e200-9242-4641-b1b0-9da484bc90ea service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:36.396535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 700/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:37.046207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71891-2504-4344-be97-0d3c987636ba None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:37.046679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71891-2504-4344-be97-0d3c987636ba None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:37.046774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b71891-2504-4344-be97-0d3c987636ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:37.095225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-44b71891-2504-4344-be97-0d3c987636ba None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:37.096422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-44b71891-2504-4344-be97-0d3c987636ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:37.163802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 703/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:37.204718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd669-27da-4223-ba1e-42e1d98e052e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:37.205288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd669-27da-4223-ba1e-42e1d98e052e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:37.205725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fd669-27da-4223-ba1e-42e1d98e052e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:37.207243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 701/1404] 10.222.0.36 () {54 vars in 942 bytes} [Wed Jun 22 08:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:37.214019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b641d-8945-401d-878f-23901ac4a2a9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:37.214344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b641d-8945-401d-878f-23901ac4a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:37.214652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b641d-8945-401d-878f-23901ac4a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:37.265299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e74b641d-8945-401d-878f-23901ac4a2a9 None None] MFA Rules not processed for user `05a163118f6f44fdbad0c7c889970a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:37.266597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e74b641d-8945-401d-878f-23901ac4a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:37.300602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:37.339394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 704/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Wed Jun 22 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:37.349165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd669-27da-4223-ba1e-42e1d98e052e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:37.356545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:37.363369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fd669-27da-4223-ba1e-42e1d98e052e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:37.368268 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264c728-58e1-4f21-8366-c98cbcd21490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:37.368902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c728-58e1-4f21-8366-c98cbcd21490 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:37.369184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c728-58e1-4f21-8366-c98cbcd21490 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:37.369460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264c728-58e1-4f21-8366-c98cbcd21490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:37.378454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264c728-58e1-4f21-8366-c98cbcd21490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:37.380025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264c728-58e1-4f21-8366-c98cbcd21490 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:37.388847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 702/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 08:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 08:53:38.757966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f9e5d-7b66-4a8d-b335-811318f4db8d None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:38.758546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f9e5d-7b66-4a8d-b335-811318f4db8d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:38.758546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f9e5d-7b66-4a8d-b335-811318f4db8d None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:38.760001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 705/1407] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:53:38.765163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686da2e-dcab-4628-8631-6eec5ef34012 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:38.765552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686da2e-dcab-4628-8631-6eec5ef34012 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:38.765718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686da2e-dcab-4628-8631-6eec5ef34012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:38.786701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1686da2e-dcab-4628-8631-6eec5ef34012 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:53:38.787906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1686da2e-dcab-4628-8631-6eec5ef34012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:53:38.802167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 703/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:53:38.846215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f9e5d-7b66-4a8d-b335-811318f4db8d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:53:38.865074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f9e5d-7b66-4a8d-b335-811318f4db8d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:53:38.870668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec7acd-2625-4502-8a4f-fa93e54ccc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:53:38.871395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec7acd-2625-4502-8a4f-fa93e54ccc0b service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:53:38.871677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec7acd-2625-4502-8a4f-fa93e54ccc0b service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:53:38.872091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec7acd-2625-4502-8a4f-fa93e54ccc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:53:38.883058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec7acd-2625-4502-8a4f-fa93e54ccc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:53:38.884622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec7acd-2625-4502-8a4f-fa93e54ccc0b service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:53:38.898604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 706/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:53:48.782444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=8 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:53:48.893758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=21 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:01.458482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1900ca-f725-4c21-9021-06960faf0768 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:01.459064 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1900ca-f725-4c21-9021-06960faf0768 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:01.459064 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1900ca-f725-4c21-9021-06960faf0768 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:01.460384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 704/1410] 10.222.0.36 () {54 vars in 918 bytes} [Wed Jun 22 08:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:01.465505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7983128-c47c-4921-ba07-d122d7bc8504 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:01.465951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7983128-c47c-4921-ba07-d122d7bc8504 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:01.466095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7983128-c47c-4921-ba07-d122d7bc8504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:01.483711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e7983128-c47c-4921-ba07-d122d7bc8504 None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:01.484895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e7983128-c47c-4921-ba07-d122d7bc8504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:01.493727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 707/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jun 22 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:01.508895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73ca7-d35c-4bcb-ad87-ff4fb8be430b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:01.509199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73ca7-d35c-4bcb-ad87-ff4fb8be430b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:01.509485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea73ca7-d35c-4bcb-ad87-ff4fb8be430b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:01.510890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 705/1412] 10.222.0.36 () {54 vars in 918 bytes} [Wed Jun 22 08:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:01.515421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa583d9-53a7-42e7-969d-b2a7fad090f3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:01.515710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa583d9-53a7-42e7-969d-b2a7fad090f3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:01.515988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa583d9-53a7-42e7-969d-b2a7fad090f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:01.534569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9aa583d9-53a7-42e7-969d-b2a7fad090f3 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:01.535790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9aa583d9-53a7-42e7-969d-b2a7fad090f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:01.545067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 708/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jun 22 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:54:04.054994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013e2a-abef-4514-b284-ea2c418e1271 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:04.055586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013e2a-abef-4514-b284-ea2c418e1271 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:04.055586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013e2a-abef-4514-b284-ea2c418e1271 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:04.056901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:04.061974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ad99-91b7-4ea4-851d-9434ada3b484 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:04.062385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ad99-91b7-4ea4-851d-9434ada3b484 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:04.062575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63ad99-91b7-4ea4-851d-9434ada3b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:04.080477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8a63ad99-91b7-4ea4-851d-9434ada3b484 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:04.081645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8a63ad99-91b7-4ea4-851d-9434ada3b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:04.089238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:04.132818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1013e2a-abef-4514-b284-ea2c418e1271 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:04.147291 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1013e2a-abef-4514-b284-ea2c418e1271 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:04.152629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991cf79-d2f2-4296-b8a1-d49dfd80109c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:04.153257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991cf79-d2f2-4296-b8a1-d49dfd80109c service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:04.153535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991cf79-d2f2-4296-b8a1-d49dfd80109c service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:04.153833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991cf79-d2f2-4296-b8a1-d49dfd80109c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:04.162692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991cf79-d2f2-4296-b8a1-d49dfd80109c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:04.164363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991cf79-d2f2-4296-b8a1-d49dfd80109c service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:04.173530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 707/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:05.070860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e876b-f9ed-4233-b495-ef299e9fb2a1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:05.071423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e876b-f9ed-4233-b495-ef299e9fb2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:05.071423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e876b-f9ed-4233-b495-ef299e9fb2a1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:05.072777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:05.077748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296cc0b-d692-4b2a-9a83-ce2aeaf3b9df None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:05.078173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296cc0b-d692-4b2a-9a83-ce2aeaf3b9df None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:05.078339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296cc0b-d692-4b2a-9a83-ce2aeaf3b9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:05.096222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6296cc0b-d692-4b2a-9a83-ce2aeaf3b9df None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:05.097344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6296cc0b-d692-4b2a-9a83-ce2aeaf3b9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:05.105114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:05.255512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e876b-f9ed-4233-b495-ef299e9fb2a1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:05.269598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e876b-f9ed-4233-b495-ef299e9fb2a1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:05.274961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04540e90-1ab7-49f5-8626-1d308aa46bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:05.275593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04540e90-1ab7-49f5-8626-1d308aa46bbf service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:05.275873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04540e90-1ab7-49f5-8626-1d308aa46bbf service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:05.276148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04540e90-1ab7-49f5-8626-1d308aa46bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:05.284770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04540e90-1ab7-49f5-8626-1d308aa46bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:05.286344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04540e90-1ab7-49f5-8626-1d308aa46bbf service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:05.300269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 711/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:54:06.186947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847537-ad4e-4482-bf37-b5c441b69f5b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:06.187457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847537-ad4e-4482-bf37-b5c441b69f5b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:06.187457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12847537-ad4e-4482-bf37-b5c441b69f5b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:06.189473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:06.194372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d3f2b-f418-471b-b580-96862c3ce73c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:06.194784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d3f2b-f418-471b-b580-96862c3ce73c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:06.194924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d3f2b-f418-471b-b580-96862c3ce73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:06.214233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-462d3f2b-f418-471b-b580-96862c3ce73c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:06.215411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-462d3f2b-f418-471b-b580-96862c3ce73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:06.223374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:06.374249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847537-ad4e-4482-bf37-b5c441b69f5b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:06.388211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12847537-ad4e-4482-bf37-b5c441b69f5b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:06.394147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767d47d-1d81-49ab-923e-ed7b374d0e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:06.394773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d47d-1d81-49ab-923e-ed7b374d0e4f service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:06.395094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d47d-1d81-49ab-923e-ed7b374d0e4f service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:06.395370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767d47d-1d81-49ab-923e-ed7b374d0e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:06.403561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767d47d-1d81-49ab-923e-ed7b374d0e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:06.405135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767d47d-1d81-49ab-923e-ed7b374d0e4f service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:06.415446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 710/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 08:54:07.279024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b478-23f4-444f-9ca6-eaad943cecf4 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:07.279578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b478-23f4-444f-9ca6-eaad943cecf4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:07.279578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b478-23f4-444f-9ca6-eaad943cecf4 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:07.280933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:07.286482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2d65-ce3f-4c9f-9540-63188a873c76 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:07.286914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2d65-ce3f-4c9f-9540-63188a873c76 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:07.287044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc2d65-ce3f-4c9f-9540-63188a873c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:07.305770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dccc2d65-ce3f-4c9f-9540-63188a873c76 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:07.307016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dccc2d65-ce3f-4c9f-9540-63188a873c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:07.314704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:07.465083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93b478-23f4-444f-9ca6-eaad943cecf4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:07.479308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93b478-23f4-444f-9ca6-eaad943cecf4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:07.484676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a263ab-78ef-4d9f-8c85-b2f19bfa3e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:07.485315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a263ab-78ef-4d9f-8c85-b2f19bfa3e5f service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:07.485601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a263ab-78ef-4d9f-8c85-b2f19bfa3e5f service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:07.485965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a263ab-78ef-4d9f-8c85-b2f19bfa3e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:07.494080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a263ab-78ef-4d9f-8c85-b2f19bfa3e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:07.495685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a263ab-78ef-4d9f-8c85-b2f19bfa3e5f service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:07.505974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 714/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:08.369613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82168e09-4116-4986-9c68-d0259eeeef9c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:08.370217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82168e09-4116-4986-9c68-d0259eeeef9c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:08.370217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82168e09-4116-4986-9c68-d0259eeeef9c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:08.371583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:08.376808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581028-8925-467e-b995-c1783e4f687e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:08.377258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581028-8925-467e-b995-c1783e4f687e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:08.377360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d581028-8925-467e-b995-c1783e4f687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:08.394906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3d581028-8925-467e-b995-c1783e4f687e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:08.396096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3d581028-8925-467e-b995-c1783e4f687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:08.404043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:08.556055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82168e09-4116-4986-9c68-d0259eeeef9c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:08.571088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82168e09-4116-4986-9c68-d0259eeeef9c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:08.576492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c5b38-a5f6-49b2-b1c9-64b0a75b9f38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:08.577221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c5b38-a5f6-49b2-b1c9-64b0a75b9f38 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:08.577511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c5b38-a5f6-49b2-b1c9-64b0a75b9f38 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:08.577791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c5b38-a5f6-49b2-b1c9-64b0a75b9f38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:08.586907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c5b38-a5f6-49b2-b1c9-64b0a75b9f38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:08.588468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c5b38-a5f6-49b2-b1c9-64b0a75b9f38 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:08.598669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 713/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:09.460354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2a72-c135-4e30-98d0-f29a8c969c71 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:09.460930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2a72-c135-4e30-98d0-f29a8c969c71 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:09.460930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d2a72-c135-4e30-98d0-f29a8c969c71 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:09.462355 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:09.467286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b006-210c-4227-832a-10459c075c56 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:09.467667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b006-210c-4227-832a-10459c075c56 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:09.467875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b006-210c-4227-832a-10459c075c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:09.486091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ad95b006-210c-4227-832a-10459c075c56 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:09.487303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ad95b006-210c-4227-832a-10459c075c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:09.495424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:09.650301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d2a72-c135-4e30-98d0-f29a8c969c71 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:09.664716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d2a72-c135-4e30-98d0-f29a8c969c71 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:09.670000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73029f7-10f5-4af8-9e1f-96726497e1e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:09.670682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73029f7-10f5-4af8-9e1f-96726497e1e5 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:09.670963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73029f7-10f5-4af8-9e1f-96726497e1e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:09.671238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73029f7-10f5-4af8-9e1f-96726497e1e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:09.679338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73029f7-10f5-4af8-9e1f-96726497e1e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:09.680882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73029f7-10f5-4af8-9e1f-96726497e1e5 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:09.690530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 717/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:10.567530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5ea1-8814-4739-a169-7bc78e81a517 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:10.568043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5ea1-8814-4739-a169-7bc78e81a517 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:10.568043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5ea1-8814-4739-a169-7bc78e81a517 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:10.569383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:10.574557 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc33fa-9ee0-4975-abd1-4c8ced228d1f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:10.575000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc33fa-9ee0-4975-abd1-4c8ced228d1f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:10.575109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc33fa-9ee0-4975-abd1-4c8ced228d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:10.592948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5ebc33fa-9ee0-4975-abd1-4c8ced228d1f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:10.594172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5ebc33fa-9ee0-4975-abd1-4c8ced228d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:10.602844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:10.755375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a5ea1-8814-4739-a169-7bc78e81a517 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:10.770212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a5ea1-8814-4739-a169-7bc78e81a517 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:10.775473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7582ba9-d05e-4924-a03f-9223a140f69e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:10.776099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582ba9-d05e-4924-a03f-9223a140f69e service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:10.776376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582ba9-d05e-4924-a03f-9223a140f69e service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:10.776647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7582ba9-d05e-4924-a03f-9223a140f69e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:10.785299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7582ba9-d05e-4924-a03f-9223a140f69e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:10.786893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7582ba9-d05e-4924-a03f-9223a140f69e service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:10.796003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 716/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:11.664186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b95a-f656-4f3d-aece-c1d318a2a184 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:11.664720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b95a-f656-4f3d-aece-c1d318a2a184 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:11.664720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722b95a-f656-4f3d-aece-c1d318a2a184 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:11.666126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:11.671051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc711c2-9232-45c2-a4bc-c66304a69596 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:11.671474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc711c2-9232-45c2-a4bc-c66304a69596 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:11.671607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc711c2-9232-45c2-a4bc-c66304a69596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:11.690174 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-acc711c2-9232-45c2-a4bc-c66304a69596 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:11.691356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-acc711c2-9232-45c2-a4bc-c66304a69596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:11.698933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:11.849866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b95a-f656-4f3d-aece-c1d318a2a184 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:11.864694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722b95a-f656-4f3d-aece-c1d318a2a184 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:11.870124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3d5af-e7da-41ec-8979-4ae5b6d196d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:11.870757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d5af-e7da-41ec-8979-4ae5b6d196d8 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:11.871040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d5af-e7da-41ec-8979-4ae5b6d196d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:11.871317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3d5af-e7da-41ec-8979-4ae5b6d196d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:11.880430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d5af-e7da-41ec-8979-4ae5b6d196d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:11.881977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3d5af-e7da-41ec-8979-4ae5b6d196d8 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:11.891177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 720/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:12.776163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e214-cb63-40bb-ac8e-fbda360b27e1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:12.776803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e214-cb63-40bb-ac8e-fbda360b27e1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:12.776803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e214-cb63-40bb-ac8e-fbda360b27e1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:12.778135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:12.783193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6cf56-15be-4b96-8e19-81110e66e643 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:12.783628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6cf56-15be-4b96-8e19-81110e66e643 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:12.783734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6cf56-15be-4b96-8e19-81110e66e643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:12.801331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b5f6cf56-15be-4b96-8e19-81110e66e643 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:12.802559 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b5f6cf56-15be-4b96-8e19-81110e66e643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:12.810493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:12.960036 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e214-cb63-40bb-ac8e-fbda360b27e1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:12.974433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e214-cb63-40bb-ac8e-fbda360b27e1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:12.979662 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa014a4c-7398-4ac6-9a1f-72471b5d2600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:12.980282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa014a4c-7398-4ac6-9a1f-72471b5d2600 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:12.980558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa014a4c-7398-4ac6-9a1f-72471b5d2600 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:12.980833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa014a4c-7398-4ac6-9a1f-72471b5d2600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:12.989454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa014a4c-7398-4ac6-9a1f-72471b5d2600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:12.991043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa014a4c-7398-4ac6-9a1f-72471b5d2600 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:13.000498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 719/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:14.941157 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2c19-ec55-4166-8e13-3369730ad10a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:14.941704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2c19-ec55-4166-8e13-3369730ad10a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:14.941704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2c19-ec55-4166-8e13-3369730ad10a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:14.943234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:14.948450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f810-66c6-41e1-b5e8-f41b37729886 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:14.948861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f810-66c6-41e1-b5e8-f41b37729886 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:14.949034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f810-66c6-41e1-b5e8-f41b37729886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:14.967558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f430f810-66c6-41e1-b5e8-f41b37729886 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:14.968750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f430f810-66c6-41e1-b5e8-f41b37729886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:14.976566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:15.015768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2c19-ec55-4166-8e13-3369730ad10a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:15.027121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2c19-ec55-4166-8e13-3369730ad10a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:15.030657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708712dc-586d-48be-9292-4c40058864be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:15.031304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708712dc-586d-48be-9292-4c40058864be service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:15.031595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708712dc-586d-48be-9292-4c40058864be service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:15.031875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708712dc-586d-48be-9292-4c40058864be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:15.040751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708712dc-586d-48be-9292-4c40058864be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:15.042565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708712dc-586d-48be-9292-4c40058864be service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:15.051950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 723/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:17.260179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627236-f48c-486f-b7d1-3993af26103a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:17.260733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627236-f48c-486f-b7d1-3993af26103a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:17.260845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c627236-f48c-486f-b7d1-3993af26103a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:17.262152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:17.268224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e63a1-3f18-47a5-ac61-c73f4460c778 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:17.268624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e63a1-3f18-47a5-ac61-c73f4460c778 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:17.268772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e63a1-3f18-47a5-ac61-c73f4460c778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:17.286249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e40e63a1-3f18-47a5-ac61-c73f4460c778 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:17.287431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e40e63a1-3f18-47a5-ac61-c73f4460c778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:17.295094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:17.333918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c627236-f48c-486f-b7d1-3993af26103a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:17.344748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c627236-f48c-486f-b7d1-3993af26103a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:17.348472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed3c22-1c14-4573-9cab-b7adfc87a6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:17.349100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3c22-1c14-4573-9cab-b7adfc87a6de service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:17.349380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3c22-1c14-4573-9cab-b7adfc87a6de service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:17.349653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed3c22-1c14-4573-9cab-b7adfc87a6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:17.358578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed3c22-1c14-4573-9cab-b7adfc87a6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:17.360189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed3c22-1c14-4573-9cab-b7adfc87a6de service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:17.369511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 722/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:19.798330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e563-8299-4bda-8d0b-b84c288cfd38 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:19.798913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e563-8299-4bda-8d0b-b84c288cfd38 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:19.798913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e563-8299-4bda-8d0b-b84c288cfd38 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:19.800276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:19.805447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef14d1-76f4-4e32-82d8-205eae10206e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:19.805875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef14d1-76f4-4e32-82d8-205eae10206e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:19.806016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef14d1-76f4-4e32-82d8-205eae10206e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:19.823760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-69ef14d1-76f4-4e32-82d8-205eae10206e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:19.824960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-69ef14d1-76f4-4e32-82d8-205eae10206e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:19.833314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:19.871396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e563-8299-4bda-8d0b-b84c288cfd38 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:19.882368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e563-8299-4bda-8d0b-b84c288cfd38 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:19.885878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271e9cd-6bd3-43d8-a734-5310615e4900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:19.886534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e9cd-6bd3-43d8-a734-5310615e4900 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:19.886818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e9cd-6bd3-43d8-a734-5310615e4900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:19.887092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271e9cd-6bd3-43d8-a734-5310615e4900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:19.896502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271e9cd-6bd3-43d8-a734-5310615e4900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:19.897910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271e9cd-6bd3-43d8-a734-5310615e4900 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:19.907711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 726/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:22.082023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bd5c-7298-4474-8b09-27c00b57d4a6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:22.082572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bd5c-7298-4474-8b09-27c00b57d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:22.082669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bd5c-7298-4474-8b09-27c00b57d4a6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:22.083996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:22.089249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be16b-d7e5-495c-9da6-c3ffbcf1a063 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:22.089672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be16b-d7e5-495c-9da6-c3ffbcf1a063 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:22.089768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be16b-d7e5-495c-9da6-c3ffbcf1a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:22.107513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-685be16b-d7e5-495c-9da6-c3ffbcf1a063 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:22.108746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-685be16b-d7e5-495c-9da6-c3ffbcf1a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:22.117260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:22.156216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265bd5c-7298-4474-8b09-27c00b57d4a6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:22.166868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265bd5c-7298-4474-8b09-27c00b57d4a6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:22.170321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb4415-5155-451e-b3f5-6a2485de22ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:22.170945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb4415-5155-451e-b3f5-6a2485de22ce service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:22.171235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb4415-5155-451e-b3f5-6a2485de22ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:22.171497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb4415-5155-451e-b3f5-6a2485de22ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:22.180990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb4415-5155-451e-b3f5-6a2485de22ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:22.182471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb4415-5155-451e-b3f5-6a2485de22ce service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:22.192437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 725/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:24.262986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91fd9-8b40-4fc1-9e56-75e3ed9157b1 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:24.263484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91fd9-8b40-4fc1-9e56-75e3ed9157b1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:24.263582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb91fd9-8b40-4fc1-9e56-75e3ed9157b1 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:24.264973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:24.270365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05984-ecdb-49ae-8b05-a373ba2477c6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:24.270774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05984-ecdb-49ae-8b05-a373ba2477c6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:24.270920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05984-ecdb-49ae-8b05-a373ba2477c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:24.288522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dbb05984-ecdb-49ae-8b05-a373ba2477c6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:24.289704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dbb05984-ecdb-49ae-8b05-a373ba2477c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:24.298046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:24.336763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb91fd9-8b40-4fc1-9e56-75e3ed9157b1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:24.347361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb91fd9-8b40-4fc1-9e56-75e3ed9157b1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:24.350844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67ba7b-898a-43e5-8512-bf5696874671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:24.351472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67ba7b-898a-43e5-8512-bf5696874671 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:24.351754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67ba7b-898a-43e5-8512-bf5696874671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:24.352026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67ba7b-898a-43e5-8512-bf5696874671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:24.361412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67ba7b-898a-43e5-8512-bf5696874671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:24.362835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67ba7b-898a-43e5-8512-bf5696874671 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:24.372240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 729/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:26.535809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430048-9550-4d7f-8788-536c17f758b0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:26.536321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430048-9550-4d7f-8788-536c17f758b0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:26.536321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430048-9550-4d7f-8788-536c17f758b0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:26.537638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:26.543056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa15c-82e0-4a0f-9f84-63a0052eb6d1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:26.543450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa15c-82e0-4a0f-9f84-63a0052eb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:26.543604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa15c-82e0-4a0f-9f84-63a0052eb6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:26.561008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5a7fa15c-82e0-4a0f-9f84-63a0052eb6d1 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:26.562227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5a7fa15c-82e0-4a0f-9f84-63a0052eb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:26.569951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:26.609651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d430048-9550-4d7f-8788-536c17f758b0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:26.620358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d430048-9550-4d7f-8788-536c17f758b0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:26.624083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07832ae8-6231-40aa-b239-94e3a0e9c2d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:26.624706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07832ae8-6231-40aa-b239-94e3a0e9c2d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:26.624983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07832ae8-6231-40aa-b239-94e3a0e9c2d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:26.625259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07832ae8-6231-40aa-b239-94e3a0e9c2d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:26.634041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07832ae8-6231-40aa-b239-94e3a0e9c2d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:26.635472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07832ae8-6231-40aa-b239-94e3a0e9c2d4 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:26.645422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 728/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:28.761340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b8752-35f6-4034-86b5-c36635637c56 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:28.761872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b8752-35f6-4034-86b5-c36635637c56 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:28.761996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b8752-35f6-4034-86b5-c36635637c56 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:28.763304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:28.769062 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437461e-3343-4702-a3f6-eb89706b3757 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:28.769464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437461e-3343-4702-a3f6-eb89706b3757 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:28.769615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437461e-3343-4702-a3f6-eb89706b3757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:28.786883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a437461e-3343-4702-a3f6-eb89706b3757 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:28.788061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a437461e-3343-4702-a3f6-eb89706b3757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:28.795684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:54:28.834044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b8752-35f6-4034-86b5-c36635637c56 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:28.844673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b8752-35f6-4034-86b5-c36635637c56 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:28.848214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb84872-13ca-4c25-a913-7c9f2bac2a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:28.848826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84872-13ca-4c25-a913-7c9f2bac2a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:28.849108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84872-13ca-4c25-a913-7c9f2bac2a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:28.849385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb84872-13ca-4c25-a913-7c9f2bac2a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:28.858147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb84872-13ca-4c25-a913-7c9f2bac2a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:28.859549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb84872-13ca-4c25-a913-7c9f2bac2a2f service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:28.870846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 732/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:31.026691 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21607bd-837a-4787-b519-dc9c5e8b34d3 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:31.027219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21607bd-837a-4787-b519-dc9c5e8b34d3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:31.027337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21607bd-837a-4787-b519-dc9c5e8b34d3 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:31.028621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:31.035047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822299e-eb44-4f1e-94ba-1dab3ede6315 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:31.035503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822299e-eb44-4f1e-94ba-1dab3ede6315 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:31.035602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822299e-eb44-4f1e-94ba-1dab3ede6315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:31.041785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=79 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:31.053996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1822299e-eb44-4f1e-94ba-1dab3ede6315 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:31.059837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1822299e-eb44-4f1e-94ba-1dab3ede6315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:31.063507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:31.101386 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21607bd-837a-4787-b519-dc9c5e8b34d3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:31.106847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=73 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:31.112438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21607bd-837a-4787-b519-dc9c5e8b34d3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:31.116025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a254b-4459-4b8e-92a4-59742f7f6b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:31.119195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a254b-4459-4b8e-92a4-59742f7f6b67 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:31.119195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a254b-4459-4b8e-92a4-59742f7f6b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:31.119195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a254b-4459-4b8e-92a4-59742f7f6b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:31.126451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a254b-4459-4b8e-92a4-59742f7f6b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:31.127870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a254b-4459-4b8e-92a4-59742f7f6b67 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:31.137657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 731/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:33.253502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631737-ae8e-4050-9e8e-c933a3c4a654 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:33.254032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631737-ae8e-4050-9e8e-c933a3c4a654 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:33.254174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631737-ae8e-4050-9e8e-c933a3c4a654 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:33.255463 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:33.260832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298d7f3-d046-4cd0-8cfb-5ac99110fbec None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:33.261242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298d7f3-d046-4cd0-8cfb-5ac99110fbec None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:33.261388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298d7f3-d046-4cd0-8cfb-5ac99110fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:33.279226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e298d7f3-d046-4cd0-8cfb-5ac99110fbec None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:33.280409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e298d7f3-d046-4cd0-8cfb-5ac99110fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:33.288813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:33.324913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631737-ae8e-4050-9e8e-c933a3c4a654 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:33.336029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631737-ae8e-4050-9e8e-c933a3c4a654 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:33.339509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553b4b-3cb7-480a-a05a-9c6f0ce561e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:33.340136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553b4b-3cb7-480a-a05a-9c6f0ce561e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:33.340417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553b4b-3cb7-480a-a05a-9c6f0ce561e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:33.340691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553b4b-3cb7-480a-a05a-9c6f0ce561e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:33.350031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35553b4b-3cb7-480a-a05a-9c6f0ce561e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:33.351554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35553b4b-3cb7-480a-a05a-9c6f0ce561e8 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:33.360814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 735/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:35.386636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d51e-a8cf-4f21-9336-78d2368e96c2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:35.387196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d51e-a8cf-4f21-9336-78d2368e96c2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:35.387196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d51e-a8cf-4f21-9336-78d2368e96c2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:35.388559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:35.394333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd0bac-3228-490d-9872-5851b0b55feb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:35.394780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd0bac-3228-490d-9872-5851b0b55feb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:35.394885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd0bac-3228-490d-9872-5851b0b55feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:35.412267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a3fd0bac-3228-490d-9872-5851b0b55feb None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:35.413451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a3fd0bac-3228-490d-9872-5851b0b55feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:35.421134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:35.457713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70d51e-a8cf-4f21-9336-78d2368e96c2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:35.468216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70d51e-a8cf-4f21-9336-78d2368e96c2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:35.472049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95b471-eda5-439c-91e8-2a1451a01381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:35.472690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95b471-eda5-439c-91e8-2a1451a01381 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:35.472982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95b471-eda5-439c-91e8-2a1451a01381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:35.473258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95b471-eda5-439c-91e8-2a1451a01381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:35.481957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95b471-eda5-439c-91e8-2a1451a01381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:35.483388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95b471-eda5-439c-91e8-2a1451a01381 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:35.493300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 734/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:45.407262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=11 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:45.489038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=14 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:54:55.310492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5b74-1004-4d61-b2d2-80aca6263199 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:55.311102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5b74-1004-4d61-b2d2-80aca6263199 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:55.311102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5b74-1004-4d61-b2d2-80aca6263199 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:55.312966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 737/1471] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:55.318833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa65c-5ff1-45db-b2b4-142439264c4a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:55.319315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa65c-5ff1-45db-b2b4-142439264c4a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:55.319418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa65c-5ff1-45db-b2b4-142439264c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:55.337398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6b3fa65c-5ff1-45db-b2b4-142439264c4a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:55.338619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6b3fa65c-5ff1-45db-b2b4-142439264c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:55.347354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 735/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:55.395240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff00bc-36e8-479b-9213-df4e6680c55c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:55.395529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff00bc-36e8-479b-9213-df4e6680c55c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:55.395805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff00bc-36e8-479b-9213-df4e6680c55c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:55.397151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 738/1473] 10.222.0.36 () {54 vars in 962 bytes} [Wed Jun 22 08:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:55.401806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d773f-e1d0-4a98-a9e1-800f4a35d810 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:55.402136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d773f-e1d0-4a98-a9e1-800f4a35d810 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:55.402424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d773f-e1d0-4a98-a9e1-800f4a35d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:55.420125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-be2d773f-e1d0-4a98-a9e1-800f4a35d810 None None] MFA Rules not processed for user `bb36ac7a2e4643009bc1b0ca599203f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:55.421459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-be2d773f-e1d0-4a98-a9e1-800f4a35d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:55.427929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 736/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Wed Jun 22 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:55.435064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff00bc-36e8-479b-9213-df4e6680c55c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:55.446193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff00bc-36e8-479b-9213-df4e6680c55c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:55.449607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76bc2-910e-4184-a5fe-6b3de3ab47bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb36ac7a2e4643009bc1b0ca599203f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:55.450264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76bc2-910e-4184-a5fe-6b3de3ab47bf service glance] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:55.450546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76bc2-910e-4184-a5fe-6b3de3ab47bf service glance] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:55.450814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76bc2-910e-4184-a5fe-6b3de3ab47bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:55.460292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76bc2-910e-4184-a5fe-6b3de3ab47bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:55.461679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76bc2-910e-4184-a5fe-6b3de3ab47bf service glance] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:55.470852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 739/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:54:57.594140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b40cb-875c-46c0-bf6e-4e1d00d153f5 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:57.594723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b40cb-875c-46c0-bf6e-4e1d00d153f5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:57.594723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b40cb-875c-46c0-bf6e-4e1d00d153f5 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:57.596559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 737/1476] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:57.601322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5e952-259c-4f4e-94b2-f0734f45dece None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:57.601773 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5e952-259c-4f4e-94b2-f0734f45dece None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:57.601880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5e952-259c-4f4e-94b2-f0734f45dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:57.619746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ecc5e952-259c-4f4e-94b2-f0734f45dece None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:57.620953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ecc5e952-259c-4f4e-94b2-f0734f45dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:57.629253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 740/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:57.652693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b40cb-875c-46c0-bf6e-4e1d00d153f5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:57.665636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b40cb-875c-46c0-bf6e-4e1d00d153f5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:57.669955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b82af-17e6-4e8d-a569-b01c0a397d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:57.670622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b82af-17e6-4e8d-a569-b01c0a397d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:57.670912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b82af-17e6-4e8d-a569-b01c0a397d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:57.671894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b82af-17e6-4e8d-a569-b01c0a397d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:57.672652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b82af-17e6-4e8d-a569-b01c0a397d38 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:57.674423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-915b82af-17e6-4e8d-a569-b01c0a397d38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:54:57.674423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jun 22 08:54:57.674423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: Jun 22 08:54:57.675538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b82af-17e6-4e8d-a569-b01c0a397d38 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:57.694177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 738/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 22 08:54:57 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:54:59.748226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c04427-b265-4c5c-883e-025a9fd05553 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:59.748816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c04427-b265-4c5c-883e-025a9fd05553 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:59.748816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c04427-b265-4c5c-883e-025a9fd05553 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:59.750212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 741/1479] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:54:59.755301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519593ee-3d6c-4e95-ad0b-ac830f737577 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:59.755729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519593ee-3d6c-4e95-ad0b-ac830f737577 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:59.755861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519593ee-3d6c-4e95-ad0b-ac830f737577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:59.774297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-519593ee-3d6c-4e95-ad0b-ac830f737577 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:54:59.775492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-519593ee-3d6c-4e95-ad0b-ac830f737577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:54:59.783827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 739/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:54:59.825889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c04427-b265-4c5c-883e-025a9fd05553 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:54:59.842589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c04427-b265-4c5c-883e-025a9fd05553 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:54:59.847225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5737c-5a05-43c4-9579-ef79b8db9b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:54:59.847862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5737c-5a05-43c4-9579-ef79b8db9b81 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:54:59.848146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5737c-5a05-43c4-9579-ef79b8db9b81 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:54:59.848423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5737c-5a05-43c4-9579-ef79b8db9b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:54:59.856606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5737c-5a05-43c4-9579-ef79b8db9b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:54:59.858199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5737c-5a05-43c4-9579-ef79b8db9b81 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:54:59.867670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 742/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:02.072231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ae6a2-b277-4519-9768-c2be54c216f3 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:02.072750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ae6a2-b277-4519-9768-c2be54c216f3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:02.072861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ae6a2-b277-4519-9768-c2be54c216f3 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:02.074245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 740/1482] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:55:02.080242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0de13-4406-4ca1-9f3b-e1f14347325d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:02.080692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0de13-4406-4ca1-9f3b-e1f14347325d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:02.080786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0de13-4406-4ca1-9f3b-e1f14347325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:02.098967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-dfe0de13-4406-4ca1-9f3b-e1f14347325d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:55:02.100087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dfe0de13-4406-4ca1-9f3b-e1f14347325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:02.107880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 743/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:55:02.145885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ae6a2-b277-4519-9768-c2be54c216f3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:02.156782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ae6a2-b277-4519-9768-c2be54c216f3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:02.160277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd8819-9779-4180-9e38-2ea575e965b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:02.160909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd8819-9779-4180-9e38-2ea575e965b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:02.161189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd8819-9779-4180-9e38-2ea575e965b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:02.161466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd8819-9779-4180-9e38-2ea575e965b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:02.170468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd8819-9779-4180-9e38-2ea575e965b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:02.172212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd8819-9779-4180-9e38-2ea575e965b5 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:02.181722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 741/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:04.308931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7216ee-d325-4dba-a8cd-a194afb6d869 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:04.309529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7216ee-d325-4dba-a8cd-a194afb6d869 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:04.309529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7216ee-d325-4dba-a8cd-a194afb6d869 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:04.310905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 744/1485] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:55:04.316949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825e2c-f333-43ba-bd8b-92deadd5f68e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:04.317376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825e2c-f333-43ba-bd8b-92deadd5f68e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:04.317484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825e2c-f333-43ba-bd8b-92deadd5f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:04.336243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d5825e2c-f333-43ba-bd8b-92deadd5f68e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:55:04.337436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d5825e2c-f333-43ba-bd8b-92deadd5f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:04.346133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 742/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:55:04.384584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7216ee-d325-4dba-a8cd-a194afb6d869 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:04.395268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7216ee-d325-4dba-a8cd-a194afb6d869 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:04.398770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449f19a-8201-4be7-8bb1-dcb13c1d207f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:04.399395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449f19a-8201-4be7-8bb1-dcb13c1d207f service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:04.399705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449f19a-8201-4be7-8bb1-dcb13c1d207f service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:04.399983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449f19a-8201-4be7-8bb1-dcb13c1d207f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:04.409528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449f19a-8201-4be7-8bb1-dcb13c1d207f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:04.410967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449f19a-8201-4be7-8bb1-dcb13c1d207f service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:04.420164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 745/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:06.615333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097730a-e2f7-453e-b286-0e179d0a3325 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:06.615865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097730a-e2f7-453e-b286-0e179d0a3325 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:06.615865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097730a-e2f7-453e-b286-0e179d0a3325 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:06.617173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 743/1488] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:55:06.622679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ba30-6669-4a7d-bacd-41334b6f97c1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:06.623106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ba30-6669-4a7d-bacd-41334b6f97c1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:06.623222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ba30-6669-4a7d-bacd-41334b6f97c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:06.640835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3c22ba30-6669-4a7d-bacd-41334b6f97c1 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:55:06.642082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3c22ba30-6669-4a7d-bacd-41334b6f97c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:06.649939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 746/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:55:06.690820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097730a-e2f7-453e-b286-0e179d0a3325 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:06.701307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097730a-e2f7-453e-b286-0e179d0a3325 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:06.705233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815de96-3ec7-4df6-8a8f-f2d4fc01b7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:06.705660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815de96-3ec7-4df6-8a8f-f2d4fc01b7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:06.705898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815de96-3ec7-4df6-8a8f-f2d4fc01b7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:06.706208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815de96-3ec7-4df6-8a8f-f2d4fc01b7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:06.715230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815de96-3ec7-4df6-8a8f-f2d4fc01b7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:06.716659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815de96-3ec7-4df6-8a8f-f2d4fc01b7b4 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:06.726478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 744/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:09.172302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6e394-2075-4f6d-9778-e516b138736a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:09.172834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6e394-2075-4f6d-9778-e516b138736a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:09.172834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6e394-2075-4f6d-9778-e516b138736a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:09.174166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 747/1491] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 22 08:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:55:09.179302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72026-130c-4e58-a07d-6e3274685186 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:09.179705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72026-130c-4e58-a07d-6e3274685186 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:09.179866 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72026-130c-4e58-a07d-6e3274685186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:09.198624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6fb72026-130c-4e58-a07d-6e3274685186 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:55:09.199806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6fb72026-130c-4e58-a07d-6e3274685186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:55:09.208214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 745/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 22 08:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:55:09.247097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6e394-2075-4f6d-9778-e516b138736a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:55:09.258252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6e394-2075-4f6d-9778-e516b138736a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:55:09.261735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a77b0-8bb9-471d-9667-4ae1945d7974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:55:09.262405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a77b0-8bb9-471d-9667-4ae1945d7974 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:55:09.262684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a77b0-8bb9-471d-9667-4ae1945d7974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:55:09.262957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a77b0-8bb9-471d-9667-4ae1945d7974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:55:09.271598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a77b0-8bb9-471d-9667-4ae1945d7974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:55:09.273066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a77b0-8bb9-471d-9667-4ae1945d7974 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:55:09.282107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 748/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:55:19.193780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=33 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:55:19.278040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=33 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:45.878621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af55b97-785d-4a83-bf4c-62ba387dc986 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:45.879221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af55b97-785d-4a83-bf4c-62ba387dc986 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:45.879221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af55b97-785d-4a83-bf4c-62ba387dc986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:45.898632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3af55b97-785d-4a83-bf4c-62ba387dc986 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:56:45.899897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3af55b97-785d-4a83-bf4c-62ba387dc986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:56:45.908898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 746/1494] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:56:45.918732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30bbdb-1a48-4c47-9286-d9799dde22c8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:45.919266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30bbdb-1a48-4c47-9286-d9799dde22c8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:45.919266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30bbdb-1a48-4c47-9286-d9799dde22c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:45.937682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ec30bbdb-1a48-4c47-9286-d9799dde22c8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:56:45.938911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ec30bbdb-1a48-4c47-9286-d9799dde22c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:56:45.946948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 749/1495] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 08:56:45.953155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af55b97-785d-4a83-bf4c-62ba387dc986 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:45.962775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af55b97-785d-4a83-bf4c-62ba387dc986 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:45.967815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:45.968500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:45.968787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:45.969062 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:45.969780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 08:56:45.970107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:45.971186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:45.971186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jun 22 08:56:45.971186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: Jun 22 08:56:45.972071 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:45.983863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 747/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 08:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:56:45.992140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30bbdb-1a48-4c47-9286-d9799dde22c8 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:46.001890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30bbdb-1a48-4c47-9286-d9799dde22c8 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:46.006543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:46.007199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.007483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.007759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.008453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:46.010274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING py.warnings [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:46.010274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: warnings.warn(msg) Jun 22 08:56:46.010274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: Jun 22 08:56:46.011460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:46.151492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 750/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 08:56:45 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:56:46.156688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:46.167470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ca8b-c92a-47ab-b771-288680ccc18b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:46.223800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:46.224449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.224732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.225008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.225700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:46.226736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:46.226736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jun 22 08:56:46.226736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: Jun 22 08:56:46.227918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:46.333723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 748/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 08:56:46 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 08:56:46.337876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:46.348844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cc144-50a9-4b68-9a67-19c561000265 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:46.353433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:46.354147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.354410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.354681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.355477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:46.356680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING py.warnings [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:46.356680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: warnings.warn(msg) Jun 22 08:56:46.356680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: Jun 22 08:56:46.357545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:46.371049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 751/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:56:46.375843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:46.386422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca884e1-4f42-400f-a8b5-f8ce0037194d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:46.391837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ecb3a-e7aa-42cf-ae01-2e1d368b1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:46.392515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ecb3a-e7aa-42cf-ae01-2e1d368b1957 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.392797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ecb3a-e7aa-42cf-ae01-2e1d368b1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.393461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ecb3a-e7aa-42cf-ae01-2e1d368b1957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.393816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ecb3a-e7aa-42cf-ae01-2e1d368b1957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:46.394902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-713ecb3a-e7aa-42cf-ae01-2e1d368b1957 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:46.394902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jun 22 08:56:46.394902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: Jun 22 08:56:46.395789 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ecb3a-e7aa-42cf-ae01-2e1d368b1957 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:46.410040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 749/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 08:56:46.414242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:46.424840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a87079-90fe-49ad-b2e2-4fa90bf22873 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:46.429549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d60657-297e-4b05-ba4a-3487ebdb2a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:46.430480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60657-297e-4b05-ba4a-3487ebdb2a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.430762 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60657-297e-4b05-ba4a-3487ebdb2a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.431035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d60657-297e-4b05-ba4a-3487ebdb2a27 admin admin] PATH_INFO: `/v3/projects/d93535fbdca1418bb8ddbc55c35d1b89/users/eb3246bac7e04e44bd6d9d1780e90b83/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.446663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d60657-297e-4b05-ba4a-3487ebdb2a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93535fbdca1418bb8ddbc55c35d1b89, user_id=eb3246bac7e04e44bd6d9d1780e90b83, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:46.447693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING py.warnings [None req-04d60657-297e-4b05-ba4a-3487ebdb2a27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:46.447693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: warnings.warn(msg) Jun 22 08:56:46.447693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: Jun 22 08:56:46.450302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d60657-297e-4b05-ba4a-3487ebdb2a27 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:46.512452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 752/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 08:56:46 2022] PUT /identity/v3/projects/d93535fbdca1418bb8ddbc55c35d1b89/users/eb3246bac7e04e44bd6d9d1780e90b83/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:56:46.528962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59832809-d6de-4b79-8ccd-6dc5703925dd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.529252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59832809-d6de-4b79-8ccd-6dc5703925dd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.529563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59832809-d6de-4b79-8ccd-6dc5703925dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.560966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-59832809-d6de-4b79-8ccd-6dc5703925dd None None] MFA Rules not processed for user `eb3246bac7e04e44bd6d9d1780e90b83`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:56:46.562376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-59832809-d6de-4b79-8ccd-6dc5703925dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:56:46.632020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 750/1502] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:56:46.646832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e94ad4-f377-49f3-b094-0b3a8bfb68ae None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.647156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e94ad4-f377-49f3-b094-0b3a8bfb68ae None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.647472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e94ad4-f377-49f3-b094-0b3a8bfb68ae None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.648952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 753/1503] 10.222.0.36 () {54 vars in 963 bytes} [Wed Jun 22 08:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:56:46.653937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710c15-bd24-47ef-8345-bf4ba4ef98eb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.654255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710c15-bd24-47ef-8345-bf4ba4ef98eb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.654537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8710c15-bd24-47ef-8345-bf4ba4ef98eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.674125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e8710c15-bd24-47ef-8345-bf4ba4ef98eb None None] MFA Rules not processed for user `8b95f073ece04f57a0c27cd3f5dd00cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:56:46.675244 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e8710c15-bd24-47ef-8345-bf4ba4ef98eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:56:46.722549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:46.730096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 751/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Jun 22 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:56:46.737734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e94ad4-f377-49f3-b094-0b3a8bfb68ae None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:46.748971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e94ad4-f377-49f3-b094-0b3a8bfb68ae None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:46.752489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26584b28-04cc-4286-bed5-3c1d7ecfab11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:46.753136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26584b28-04cc-4286-bed5-3c1d7ecfab11 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.753419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26584b28-04cc-4286-bed5-3c1d7ecfab11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.753696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26584b28-04cc-4286-bed5-3c1d7ecfab11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.763097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26584b28-04cc-4286-bed5-3c1d7ecfab11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:46.764530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26584b28-04cc-4286-bed5-3c1d7ecfab11 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:46.773920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 754/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:56:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:56:46.820684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5505d0-588d-4166-bad0-e7615474774b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.820979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5505d0-588d-4166-bad0-e7615474774b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.821264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5505d0-588d-4166-bad0-e7615474774b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.822618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 752/1506] 10.222.0.36 () {52 vars in 829 bytes} [Wed Jun 22 08:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:56:46.827308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26584b28-04cc-4286-bed5-3c1d7ecfab11 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:46.892604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26584b28-04cc-4286-bed5-3c1d7ecfab11 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:46.897377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:46.898295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:46.898579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:46.898852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] PATH_INFO: `/v3/users/eb3246bac7e04e44bd6d9d1780e90b83` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:46.900050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3246bac7e04e44bd6d9d1780e90b83)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:46.901057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING py.warnings [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:46.901057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: warnings.warn(msg) Jun 22 08:56:46.901057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: Jun 22 08:56:46.902325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:47.100929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3246bac7e04e44bd6d9d1780e90b83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:47.101684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3246bac7e04e44bd6d9d1780e90b83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:47.102401 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3246bac7e04e44bd6d9d1780e90b83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:47.168135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3246bac7e04e44bd6d9d1780e90b83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:47.187807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3246bac7e04e44bd6d9d1780e90b83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:47.196363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:47.206900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 755/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 08:56:46 2022] DELETE /identity/v3/users/eb3246bac7e04e44bd6d9d1780e90b83 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:56:47.211435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7d25-a07d-4e19-aba9-fef6d46776b6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:47.211902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7d25-a07d-4e19-aba9-fef6d46776b6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:47.212002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7d25-a07d-4e19-aba9-fef6d46776b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:47.229498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-582e7d25-a07d-4e19-aba9-fef6d46776b6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:56:47.230763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-582e7d25-a07d-4e19-aba9-fef6d46776b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:56:47.290543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 753/1508] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 08:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:56:47.301460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:47.305623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:56:47.360568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e9917-6e47-40be-a698-4d5e55a4a179 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:47.364135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21cc88-28ed-4d89-b567-ea0807d2fcb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:47.364787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21cc88-28ed-4d89-b567-ea0807d2fcb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:47.365071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21cc88-28ed-4d89-b567-ea0807d2fcb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:47.365349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21cc88-28ed-4d89-b567-ea0807d2fcb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:47.379999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21cc88-28ed-4d89-b567-ea0807d2fcb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:47.381406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21cc88-28ed-4d89-b567-ea0807d2fcb2 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:47.391647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 756/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:56:47.867548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7d25-a07d-4e19-aba9-fef6d46776b6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:56:47.869401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-582e7d25-a07d-4e19-aba9-fef6d46776b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:56:47.881744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7d25-a07d-4e19-aba9-fef6d46776b6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:56:47.887104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:56:47.888111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:56:47.888111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:56:47.888111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] PATH_INFO: `/v3/projects/d93535fbdca1418bb8ddbc55c35d1b89` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:56:47.888111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93535fbdca1418bb8ddbc55c35d1b89)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:56:47.888111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 08:56:47.888111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jun 22 08:56:47.888111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: Jun 22 08:56:47.892424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:56:48.006128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93535fbdca1418bb8ddbc55c35d1b89', 'request_id': 'req-89230627-d4dd-465a-bd3a-88bad4f363c8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:48.012180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93535fbdca1418bb8ddbc55c35d1b89', 'request_id': 'req-89230627-d4dd-465a-bd3a-88bad4f363c8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:48.072375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93535fbdca1418bb8ddbc55c35d1b89', 'request_id': 'req-89230627-d4dd-465a-bd3a-88bad4f363c8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:48.093344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] The token cache is being invalidate because project d93535fbdca1418bb8ddbc55c35d1b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 08:56:48.093632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:48.094433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89230627-d4dd-465a-bd3a-88bad4f363c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 08:56:48.095996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 754/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 08:56:47 2022] DELETE /identity/v3/projects/d93535fbdca1418bb8ddbc55c35d1b89 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 08:56:57.386718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=29 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:56:58.089326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:27.477270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6969f-4dfd-48ec-9770-067bc24a66ae None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:27.477887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6969f-4dfd-48ec-9770-067bc24a66ae None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:27.477887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6969f-4dfd-48ec-9770-067bc24a66ae None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:27.479396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:27.484527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc07fc-28eb-4670-b31f-4a407caecfe5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:27.484999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc07fc-28eb-4670-b31f-4a407caecfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:27.485108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc07fc-28eb-4670-b31f-4a407caecfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:27.504463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-81dc07fc-28eb-4670-b31f-4a407caecfe5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:27.505736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-81dc07fc-28eb-4670-b31f-4a407caecfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:27.567583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:27.730927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6969f-4dfd-48ec-9770-067bc24a66ae None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:27.732625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e0d6969f-4dfd-48ec-9770-067bc24a66ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:27.812648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6969f-4dfd-48ec-9770-067bc24a66ae None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:27.818357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db351e-f1b5-46e5-80ac-057b638d5b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:27.820808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db351e-f1b5-46e5-80ac-057b638d5b5c service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:27.820808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db351e-f1b5-46e5-80ac-057b638d5b5c service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:27.820808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db351e-f1b5-46e5-80ac-057b638d5b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:27.829795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db351e-f1b5-46e5-80ac-057b638d5b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:27.831428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db351e-f1b5-46e5-80ac-057b638d5b5c service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:27.842190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 758/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:28.711680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9b42-3ffb-49c1-81f0-c0f147cddd80 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:28.712292 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9b42-3ffb-49c1-81f0-c0f147cddd80 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:28.712292 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9b42-3ffb-49c1-81f0-c0f147cddd80 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:28.714196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:28.719233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af7c2-4db0-4b33-8d1a-a04c6ec53db8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:28.719712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af7c2-4db0-4b33-8d1a-a04c6ec53db8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:28.719878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573af7c2-4db0-4b33-8d1a-a04c6ec53db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:28.738832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-573af7c2-4db0-4b33-8d1a-a04c6ec53db8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:28.740054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-573af7c2-4db0-4b33-8d1a-a04c6ec53db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:28.748709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:28.903190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d9b42-3ffb-49c1-81f0-c0f147cddd80 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:28.918531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d9b42-3ffb-49c1-81f0-c0f147cddd80 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:28.923771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cf900-bf61-4b74-b23e-be61b2ca0788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:28.924440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf900-bf61-4b74-b23e-be61b2ca0788 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:28.924723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf900-bf61-4b74-b23e-be61b2ca0788 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:28.924997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cf900-bf61-4b74-b23e-be61b2ca0788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:28.933702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf900-bf61-4b74-b23e-be61b2ca0788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:28.935295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cf900-bf61-4b74-b23e-be61b2ca0788 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:28.944785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 757/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:29.621942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615ad7-ebc7-4836-a11b-828dd74f3050 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:29.622176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615ad7-ebc7-4836-a11b-828dd74f3050 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:29.622425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0615ad7-ebc7-4836-a11b-828dd74f3050 None None] PATH_INFO: `/v3` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:29.623732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 760/1517] 10.222.0.43 () {54 vars in 925 bytes} [Wed Jun 22 08:58:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 08:58:29.629578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da501ac-1e1b-42cb-bc59-f79041531576 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:29.629867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da501ac-1e1b-42cb-bc59-f79041531576 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:29.630166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da501ac-1e1b-42cb-bc59-f79041531576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:29.648814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5da501ac-1e1b-42cb-bc59-f79041531576 None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:29.650049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5da501ac-1e1b-42cb-bc59-f79041531576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:29.715403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 758/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jun 22 08:58:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:33.730020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbd966-a3d9-4abd-aa34-7ab9cdbf80a7 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:33.730580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbd966-a3d9-4abd-aa34-7ab9cdbf80a7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:33.730693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbd966-a3d9-4abd-aa34-7ab9cdbf80a7 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:33.732715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 761/1519] 10.222.0.36 () {54 vars in 960 bytes} [Wed Jun 22 08:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:33.737878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b5db9-0fc7-44eb-8fdb-f186b76e6d43 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:33.738344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b5db9-0fc7-44eb-8fdb-f186b76e6d43 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:33.738494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b5db9-0fc7-44eb-8fdb-f186b76e6d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:33.757696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ce9b5db9-0fc7-44eb-8fdb-f186b76e6d43 None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:33.758938 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ce9b5db9-0fc7-44eb-8fdb-f186b76e6d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:33.767375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 759/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Jun 22 08:58:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:33.775027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbd966-a3d9-4abd-aa34-7ab9cdbf80a7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:33.788676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbd966-a3d9-4abd-aa34-7ab9cdbf80a7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:33.794262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543302a-b3e0-48bc-b24a-7920cb9b2bd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:33.795083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543302a-b3e0-48bc-b24a-7920cb9b2bd4 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:33.795373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543302a-b3e0-48bc-b24a-7920cb9b2bd4 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:33.795657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543302a-b3e0-48bc-b24a-7920cb9b2bd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:33.804180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543302a-b3e0-48bc-b24a-7920cb9b2bd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:33.805775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543302a-b3e0-48bc-b24a-7920cb9b2bd4 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:33.816670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 762/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:40.203801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e921f-0195-49a5-8393-78272d338cbe None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:40.204381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e921f-0195-49a5-8393-78272d338cbe None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:40.204381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e921f-0195-49a5-8393-78272d338cbe None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:40.205651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:40.210794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6be1af-92e9-4e45-8ef0-10d8b0fb54fb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:40.211246 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6be1af-92e9-4e45-8ef0-10d8b0fb54fb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:40.211350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6be1af-92e9-4e45-8ef0-10d8b0fb54fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:40.232909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7b6be1af-92e9-4e45-8ef0-10d8b0fb54fb None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:40.234188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7b6be1af-92e9-4e45-8ef0-10d8b0fb54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:40.242268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:40.397282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e921f-0195-49a5-8393-78272d338cbe None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:40.411744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e921f-0195-49a5-8393-78272d338cbe None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:40.417136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed944ff-6ea3-4e1f-8e38-f17d2ce04549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:40.417772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed944ff-6ea3-4e1f-8e38-f17d2ce04549 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:40.418113 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed944ff-6ea3-4e1f-8e38-f17d2ce04549 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:40.418416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed944ff-6ea3-4e1f-8e38-f17d2ce04549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:40.427219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed944ff-6ea3-4e1f-8e38-f17d2ce04549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:40.428814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed944ff-6ea3-4e1f-8e38-f17d2ce04549 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:40.439046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 761/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:41.264955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930773-457c-4cb2-b904-a30cb92fd3f8 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:41.265502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930773-457c-4cb2-b904-a30cb92fd3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:41.265502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930773-457c-4cb2-b904-a30cb92fd3f8 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:41.266941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 08:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:58:41.271909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874539-b39e-49a7-b451-dee9095fd032 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:41.272343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874539-b39e-49a7-b451-dee9095fd032 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:41.272467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874539-b39e-49a7-b451-dee9095fd032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:41.290754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-09874539-b39e-49a7-b451-dee9095fd032 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:41.291942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-09874539-b39e-49a7-b451-dee9095fd032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:41.300004 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 08:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:41.453407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930773-457c-4cb2-b904-a30cb92fd3f8 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:41.468600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930773-457c-4cb2-b904-a30cb92fd3f8 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:41.473935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c247008-147e-4bae-90d4-b865879240a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:41.474593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c247008-147e-4bae-90d4-b865879240a3 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:41.474872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c247008-147e-4bae-90d4-b865879240a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:41.475141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c247008-147e-4bae-90d4-b865879240a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:41.483307 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c247008-147e-4bae-90d4-b865879240a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:41.484871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c247008-147e-4bae-90d4-b865879240a3 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:41.494277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 765/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:45.725177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d3d1-30a2-4396-84d3-f6e6b33aaed9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:45.725723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d3d1-30a2-4396-84d3-f6e6b33aaed9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:45.725723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55d3d1-30a2-4396-84d3-f6e6b33aaed9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:45.727061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:45.732985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced9f5-fbb3-426b-8747-41cc4ac6faaf None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:45.733470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced9f5-fbb3-426b-8747-41cc4ac6faaf None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:45.733588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced9f5-fbb3-426b-8747-41cc4ac6faaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:45.751564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c3ced9f5-fbb3-426b-8747-41cc4ac6faaf None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:45.752743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c3ced9f5-fbb3-426b-8747-41cc4ac6faaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:45.760492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:45.798644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55d3d1-30a2-4396-84d3-f6e6b33aaed9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:45.800420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4a55d3d1-30a2-4396-84d3-f6e6b33aaed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:45.860435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55d3d1-30a2-4396-84d3-f6e6b33aaed9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:45.863912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9e174-5147-49ab-ab7f-ecaf306d21d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:45.864557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e174-5147-49ab-ab7f-ecaf306d21d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:45.865093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e174-5147-49ab-ab7f-ecaf306d21d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:45.865368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9e174-5147-49ab-ab7f-ecaf306d21d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:45.875668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9e174-5147-49ab-ab7f-ecaf306d21d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:45.877162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9e174-5147-49ab-ab7f-ecaf306d21d6 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:45.882680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:58:45.888555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 764/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:47.952470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44b383-c256-4861-aae6-26ca1694bb47 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:47.953408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44b383-c256-4861-aae6-26ca1694bb47 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:47.953408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44b383-c256-4861-aae6-26ca1694bb47 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:47.954447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:47.959675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e22d5-ad51-4889-b41e-ec94d6a86c9f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:47.960120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e22d5-ad51-4889-b41e-ec94d6a86c9f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:47.960230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e22d5-ad51-4889-b41e-ec94d6a86c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:47.980091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7b1e22d5-ad51-4889-b41e-ec94d6a86c9f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:47.981865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7b1e22d5-ad51-4889-b41e-ec94d6a86c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:47.990865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:48.027419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44b383-c256-4861-aae6-26ca1694bb47 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:48.029248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aa44b383-c256-4861-aae6-26ca1694bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:48.042496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44b383-c256-4861-aae6-26ca1694bb47 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:48.046941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718eb68-f464-44a6-b4e1-3dc37cfa7bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:48.047591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718eb68-f464-44a6-b4e1-3dc37cfa7bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:48.047877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718eb68-f464-44a6-b4e1-3dc37cfa7bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:48.048163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718eb68-f464-44a6-b4e1-3dc37cfa7bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:48.060104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718eb68-f464-44a6-b4e1-3dc37cfa7bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:48.061662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718eb68-f464-44a6-b4e1-3dc37cfa7bd3 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:48.071823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 768/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:51.642263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3ec9f-a28c-4a47-97b7-91ed21160659 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:51.642846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3ec9f-a28c-4a47-97b7-91ed21160659 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:51.642964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3ec9f-a28c-4a47-97b7-91ed21160659 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:51.644250 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 08:58:51.649915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145380bc-25ee-4156-a115-10c13da9f3e6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:51.650764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145380bc-25ee-4156-a115-10c13da9f3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:51.650935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145380bc-25ee-4156-a115-10c13da9f3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:51.671328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-145380bc-25ee-4156-a115-10c13da9f3e6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:51.672535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-145380bc-25ee-4156-a115-10c13da9f3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:51.681312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:51.994113 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3ec9f-a28c-4a47-97b7-91ed21160659 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:51.995797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-96e3ec9f-a28c-4a47-97b7-91ed21160659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:52.055756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3ec9f-a28c-4a47-97b7-91ed21160659 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:52.059785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fc563-fb8b-4208-9cae-2be62a146a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:52.060444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fc563-fb8b-4208-9cae-2be62a146a80 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:52.060746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fc563-fb8b-4208-9cae-2be62a146a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:52.060997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fc563-fb8b-4208-9cae-2be62a146a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:52.071245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fc563-fb8b-4208-9cae-2be62a146a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:52.072682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fc563-fb8b-4208-9cae-2be62a146a80 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:52.083464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 767/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:58:54.254563 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0f47d-ee73-47fd-afea-501c1c888b70 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:54.255158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0f47d-ee73-47fd-afea-501c1c888b70 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:54.255158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0f47d-ee73-47fd-afea-501c1c888b70 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:54.256517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 08:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 08:58:54.262423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a338-6b88-4c81-b750-ac4e09faae8a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:54.263008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a338-6b88-4c81-b750-ac4e09faae8a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:54.263198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a338-6b88-4c81-b750-ac4e09faae8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:54.284869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-45b5a338-6b88-4c81-b750-ac4e09faae8a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 08:58:54.286147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-45b5a338-6b88-4c81-b750-ac4e09faae8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:54.299470 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 08:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 08:58:54.628644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0f47d-ee73-47fd-afea-501c1c888b70 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 08:58:54.630429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-60b0f47d-ee73-47fd-afea-501c1c888b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 08:58:54.644539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0f47d-ee73-47fd-afea-501c1c888b70 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 08:58:54.648346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938e28c-e9d2-4d28-82f7-83d6b42f5b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 08:58:54.649010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938e28c-e9d2-4d28-82f7-83d6b42f5b91 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 08:58:54.649289 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938e28c-e9d2-4d28-82f7-83d6b42f5b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 08:58:54.649657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938e28c-e9d2-4d28-82f7-83d6b42f5b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 08:58:54.661518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938e28c-e9d2-4d28-82f7-83d6b42f5b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 08:58:54.663006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938e28c-e9d2-4d28-82f7-83d6b42f5b91 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 08:58:54.674785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 771/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 08:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 08:59:04.278476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=32 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 08:59:04.669444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=70 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:28.724845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd783f3-18e0-4cfe-b871-f43eb43f3c92 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:28.726356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd783f3-18e0-4cfe-b871-f43eb43f3c92 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:28.726356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd783f3-18e0-4cfe-b871-f43eb43f3c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:28.768606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ffd783f3-18e0-4cfe-b871-f43eb43f3c92 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:28.771517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ffd783f3-18e0-4cfe-b871-f43eb43f3c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:28.789617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 769/1540] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:28.801194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80639-37b6-43fc-8a75-b6a101cf23d0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:28.802116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80639-37b6-43fc-8a75-b6a101cf23d0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:28.802267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80639-37b6-43fc-8a75-b6a101cf23d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:28.867720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-42b80639-37b6-43fc-8a75-b6a101cf23d0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:28.870016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-42b80639-37b6-43fc-8a75-b6a101cf23d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:28.891082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 772/1541] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:28.894983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a086e-a116-4dc0-a7d4-2d37ddd0ba7c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:28.895498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a086e-a116-4dc0-a7d4-2d37ddd0ba7c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:28.895990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a086e-a116-4dc0-a7d4-2d37ddd0ba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:28.900097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80639-37b6-43fc-8a75-b6a101cf23d0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:28.936491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80639-37b6-43fc-8a75-b6a101cf23d0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:28.955461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ec0a086e-a116-4dc0-a7d4-2d37ddd0ba7c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:28.957003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf5aeb-69ea-4dca-b206-1143b9374bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:28.958174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf5aeb-69ea-4dca-b206-1143b9374bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:28.958674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf5aeb-69ea-4dca-b206-1143b9374bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:28.959165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf5aeb-69ea-4dca-b206-1143b9374bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:28.965432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ec0a086e-a116-4dc0-a7d4-2d37ddd0ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:28.965893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf5aeb-69ea-4dca-b206-1143b9374bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:28.966379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf5aeb-69ea-4dca-b206-1143b9374bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:28.970502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING py.warnings [None req-1dbf5aeb-69ea-4dca-b206-1143b9374bbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:00:28.970502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: warnings.warn(msg) Jun 22 09:00:28.970502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: Jun 22 09:00:28.975235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf5aeb-69ea-4dca-b206-1143b9374bbd admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.005493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 770/1542] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.018947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 773/1543] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:29.028530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a086e-a116-4dc0-a7d4-2d37ddd0ba7c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:29.039936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf4f4e-27e9-44e4-9d44-4cfd64042e57 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.040453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf4f4e-27e9-44e4-9d44-4cfd64042e57 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.040955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf4f4e-27e9-44e4-9d44-4cfd64042e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.058324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a086e-a116-4dc0-a7d4-2d37ddd0ba7c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:29.081245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443b010-93cb-4cd0-86f3-316b9f642727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:29.082400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443b010-93cb-4cd0-86f3-316b9f642727 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.082882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443b010-93cb-4cd0-86f3-316b9f642727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.083392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443b010-93cb-4cd0-86f3-316b9f642727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.084676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443b010-93cb-4cd0-86f3-316b9f642727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:29.096313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-e443b010-93cb-4cd0-86f3-316b9f642727 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:00:29.096313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jun 22 09:00:29.096313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: Jun 22 09:00:29.098722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443b010-93cb-4cd0-86f3-316b9f642727 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.124971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bbdf4f4e-27e9-44e4-9d44-4cfd64042e57 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.140219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bbdf4f4e-27e9-44e4-9d44-4cfd64042e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.169199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 774/1544] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.171521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e1052-d4e8-4b17-9d92-1da186ba7f9d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.172011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e1052-d4e8-4b17-9d92-1da186ba7f9d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.172508 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e1052-d4e8-4b17-9d92-1da186ba7f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.219896 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a57e1052-d4e8-4b17-9d92-1da186ba7f9d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.222162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a57e1052-d4e8-4b17-9d92-1da186ba7f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.243854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 775/1545] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.245336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e1052-d4e8-4b17-9d92-1da186ba7f9d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:29.267657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e1052-d4e8-4b17-9d92-1da186ba7f9d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:29.270742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 771/1546] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:00:29.270742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5745-eb08-47ec-aa55-b60a0b49b18d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.270742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5745-eb08-47ec-aa55-b60a0b49b18d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.271155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf5745-eb08-47ec-aa55-b60a0b49b18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.340051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8bcf5745-eb08-47ec-aa55-b60a0b49b18d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.342992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8bcf5745-eb08-47ec-aa55-b60a0b49b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.447867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:29.449371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.450196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.450928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.452521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:29.453055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:29.455192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.480058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 776/1547] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:29.481254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:29.504361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa77ced-e230-4f24-910c-02cd584ee018 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:29.518931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c70a6-c8c4-4672-954e-672ca3b6f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:29.519991 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c70a6-c8c4-4672-954e-672ca3b6f103 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.520504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c70a6-c8c4-4672-954e-672ca3b6f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.520995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c70a6-c8c4-4672-954e-672ca3b6f103 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.521903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c70a6-c8c4-4672-954e-672ca3b6f103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:29.525163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING py.warnings [None req-cc8c70a6-c8c4-4672-954e-672ca3b6f103 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:00:29.525163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: warnings.warn(msg) Jun 22 09:00:29.525163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: Jun 22 09:00:29.527243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c70a6-c8c4-4672-954e-672ca3b6f103 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.547081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 772/1548] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.548778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a892f9-d3cf-47a2-8eab-554176fd4169 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.549302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a892f9-d3cf-47a2-8eab-554176fd4169 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.549798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a892f9-d3cf-47a2-8eab-554176fd4169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.584574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-81a892f9-d3cf-47a2-8eab-554176fd4169 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.587345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-81a892f9-d3cf-47a2-8eab-554176fd4169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.596001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 773/1549] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.596848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a892f9-d3cf-47a2-8eab-554176fd4169 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:29.607083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a892f9-d3cf-47a2-8eab-554176fd4169 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:29.612263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e45676-df70-4c61-a9ee-f76b3655bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:29.613497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e45676-df70-4c61-a9ee-f76b3655bc92 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.613497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e45676-df70-4c61-a9ee-f76b3655bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.613497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e45676-df70-4c61-a9ee-f76b3655bc92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.614317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e45676-df70-4c61-a9ee-f76b3655bc92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:29.616196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e45676-df70-4c61-a9ee-f76b3655bc92 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.629708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 777/1550] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:29.631228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b530a-9eba-4413-9d44-5e745d284d2d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.631528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b530a-9eba-4413-9d44-5e745d284d2d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.634141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b530a-9eba-4413-9d44-5e745d284d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.654521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fd9b530a-9eba-4413-9d44-5e745d284d2d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.655730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fd9b530a-9eba-4413-9d44-5e745d284d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.664077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 778/1551] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.664865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b530a-9eba-4413-9d44-5e745d284d2d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:29.675237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b530a-9eba-4413-9d44-5e745d284d2d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:29.680030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c5567-8860-42e9-838c-4a0655ccc437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:29.680745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c5567-8860-42e9-838c-4a0655ccc437 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.681029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c5567-8860-42e9-838c-4a0655ccc437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.681312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c5567-8860-42e9-838c-4a0655ccc437 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.682049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c5567-8860-42e9-838c-4a0655ccc437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:29.682390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c5567-8860-42e9-838c-4a0655ccc437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:29.684092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c5567-8860-42e9-838c-4a0655ccc437 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.698271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 779/1552] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:29.699566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b857c-6e8d-490f-b515-6675b7ffff36 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.699858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b857c-6e8d-490f-b515-6675b7ffff36 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.700143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b857c-6e8d-490f-b515-6675b7ffff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.719515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1b3b857c-6e8d-490f-b515-6675b7ffff36 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.720719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1b3b857c-6e8d-490f-b515-6675b7ffff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.725133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 774/1553] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:29.728725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb259e3a-f6b6-4f21-b5ad-06c0808799f3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.728725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb259e3a-f6b6-4f21-b5ad-06c0808799f3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.728725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb259e3a-f6b6-4f21-b5ad-06c0808799f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.747542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bb259e3a-f6b6-4f21-b5ad-06c0808799f3 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.748923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bb259e3a-f6b6-4f21-b5ad-06c0808799f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.794407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 780/1554] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.800886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a649cf-3d06-4184-b02f-2e724640c25f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.801483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a649cf-3d06-4184-b02f-2e724640c25f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.803196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a649cf-3d06-4184-b02f-2e724640c25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.832201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c3a649cf-3d06-4184-b02f-2e724640c25f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.834163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c3a649cf-3d06-4184-b02f-2e724640c25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.841757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 775/1555] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.843219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb259e3a-f6b6-4f21-b5ad-06c0808799f3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:29.851547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 781/1556] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.860958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8af7-58d1-4472-97eb-351ce813af72 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.860958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8af7-58d1-4472-97eb-351ce813af72 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.860958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8af7-58d1-4472-97eb-351ce813af72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.862160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb259e3a-f6b6-4f21-b5ad-06c0808799f3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:29.867679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d074d1-cd9c-469b-9e21-90fa6aca757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:29.868654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d074d1-cd9c-469b-9e21-90fa6aca757d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.869012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d074d1-cd9c-469b-9e21-90fa6aca757d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.869354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d074d1-cd9c-469b-9e21-90fa6aca757d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.870434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d074d1-cd9c-469b-9e21-90fa6aca757d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:29.876859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d074d1-cd9c-469b-9e21-90fa6aca757d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.885615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 776/1557] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:29.886557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d074d1-cd9c-469b-9e21-90fa6aca757d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:29.891488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0b0f8af7-58d1-4472-97eb-351ce813af72 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:29.899757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0b0f8af7-58d1-4472-97eb-351ce813af72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:29.899962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d074d1-cd9c-469b-9e21-90fa6aca757d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:29.904192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1598c-f630-4a74-8b13-ed3defafac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:29.904856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1598c-f630-4a74-8b13-ed3defafac22 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.909524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1598c-f630-4a74-8b13-ed3defafac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.909695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 782/1558] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:29.909849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1598c-f630-4a74-8b13-ed3defafac22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.910001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f8af7-58d1-4472-97eb-351ce813af72 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:29.910422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1598c-f630-4a74-8b13-ed3defafac22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:29.910422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1598c-f630-4a74-8b13-ed3defafac22 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.928412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f8af7-58d1-4472-97eb-351ce813af72 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:29.933920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfd5ed-15cc-4c02-b408-ec13cdaa862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:29.934657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd5ed-15cc-4c02-b408-ec13cdaa862a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:29.934937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd5ed-15cc-4c02-b408-ec13cdaa862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:29.935213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfd5ed-15cc-4c02-b408-ec13cdaa862a admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:29.935905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfd5ed-15cc-4c02-b408-ec13cdaa862a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:29.937815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfd5ed-15cc-4c02-b408-ec13cdaa862a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:29.947453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:30.059441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 777/1559] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:30.059441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583de715-2f2c-420c-928d-6866eb1ea01e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.059441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583de715-2f2c-420c-928d-6866eb1ea01e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.059441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583de715-2f2c-420c-928d-6866eb1ea01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.066596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:30.078830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-583de715-2f2c-420c-928d-6866eb1ea01e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:30.080047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-583de715-2f2c-420c-928d-6866eb1ea01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:30.084191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 783/1560] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:29 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:30.085922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f67b-de82-49ca-b5de-b861f083f628 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.088056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f67b-de82-49ca-b5de-b861f083f628 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.088056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f67b-de82-49ca-b5de-b861f083f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.108237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f1e0f67b-de82-49ca-b5de-b861f083f628 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:30.109469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f1e0f67b-de82-49ca-b5de-b861f083f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:30.164913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 778/1561] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:30.166701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583de715-2f2c-420c-928d-6866eb1ea01e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.176314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583de715-2f2c-420c-928d-6866eb1ea01e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.178475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 784/1562] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:30.184495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0f67b-de82-49ca-b5de-b861f083f628 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.184798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.185730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.186310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.187037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.188135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:30.188727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.191704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.193840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0f67b-de82-49ca-b5de-b861f083f628 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.201207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab6d23-03d9-474c-bd2c-fbd931a9c007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.210285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6d23-03d9-474c-bd2c-fbd931a9c007 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.210285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6d23-03d9-474c-bd2c-fbd931a9c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.210285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6d23-03d9-474c-bd2c-fbd931a9c007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.210285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab6d23-03d9-474c-bd2c-fbd931a9c007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.210285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab6d23-03d9-474c-bd2c-fbd931a9c007 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.215675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 779/1563] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:30.216823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.218316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 785/1564] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:30.220835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0851e-72c6-4f49-b016-6ce68b970b1d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.221775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0851e-72c6-4f49-b016-6ce68b970b1d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.222524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0851e-72c6-4f49-b016-6ce68b970b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.231979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183732da-705a-4014-8c19-c38fee1edfd2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.238000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.242172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.242172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.242172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.242172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:30.242172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.244038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.250598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cad0851e-72c6-4f49-b016-6ce68b970b1d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:30.252356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cad0851e-72c6-4f49-b016-6ce68b970b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:30.263846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 780/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:30.264798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.264954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 786/1566] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:30.266610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0851e-72c6-4f49-b016-6ce68b970b1d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.278145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aea24-c4e6-4473-9849-0f19660360b7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.282885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0851e-72c6-4f49-b016-6ce68b970b1d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.285714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e9b84-6e02-4479-9fae-6b5df7d13ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.286509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e9b84-6e02-4479-9fae-6b5df7d13ada admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.286828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e9b84-6e02-4479-9fae-6b5df7d13ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.287236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e9b84-6e02-4479-9fae-6b5df7d13ada admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.288048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e9b84-6e02-4479-9fae-6b5df7d13ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.291541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca52a-1b4b-4e78-be46-6d5f36d0c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.291868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e9b84-6e02-4479-9fae-6b5df7d13ada admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.292625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca52a-1b4b-4e78-be46-6d5f36d0c01f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.293094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca52a-1b4b-4e78-be46-6d5f36d0c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.294683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dca52a-1b4b-4e78-be46-6d5f36d0c01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.294683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dca52a-1b4b-4e78-be46-6d5f36d0c01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.296437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dca52a-1b4b-4e78-be46-6d5f36d0c01f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.316184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 787/1567] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:30.316184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca52a-1b4b-4e78-be46-6d5f36d0c01f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.322913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dca52a-1b4b-4e78-be46-6d5f36d0c01f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.327981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.328661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.328939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.329215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.329974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:30.330294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.331867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.349499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 788/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:30.350390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.365386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a12b0-11da-4885-bcd7-c35706e11a5c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.373989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.376091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.376091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.376091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.377354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:30.377888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.380381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 781/1569] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:30 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:30.380874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.381790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e9b84-6e02-4479-9fae-6b5df7d13ada admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.398488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e9b84-6e02-4479-9fae-6b5df7d13ada admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.409245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 789/1570] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:30.409245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.414490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.416289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.416968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.417706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] PATH_INFO: `/v3/projects/5d68fd77f9ad49c3bf1033cca7472bde/users/d9af2154918a4c1fbee9f2ab67bee7dc/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.432622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ddb57-bdd8-4c59-90ea-cced622000e7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.443092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24827999-482f-46f2-966b-7139fe4fbe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.443871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827999-482f-46f2-966b-7139fe4fbe36 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.444154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827999-482f-46f2-966b-7139fe4fbe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.445137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d68fd77f9ad49c3bf1033cca7472bde, user_id=d9af2154918a4c1fbee9f2ab67bee7dc, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.445350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24827999-482f-46f2-966b-7139fe4fbe36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.445934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24827999-482f-46f2-966b-7139fe4fbe36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.447925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:00:30.447925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jun 22 09:00:30.447925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: Jun 22 09:00:30.448427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24827999-482f-46f2-966b-7139fe4fbe36 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.450771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.610336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 782/1571] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:30 2022] PUT /identity/v3/projects/5d68fd77f9ad49c3bf1033cca7472bde/users/d9af2154918a4c1fbee9f2ab67bee7dc/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:30.611651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 790/1572] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:30 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:30.611884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.612980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c9e91-7645-4444-98f6-6a4de1fee328 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.613245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c9e91-7645-4444-98f6-6a4de1fee328 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.613636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c9e91-7645-4444-98f6-6a4de1fee328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.650492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-be3c9e91-7645-4444-98f6-6a4de1fee328 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:30.652025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-be3c9e91-7645-4444-98f6-6a4de1fee328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:30.719376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ac32c-7ff9-49e0-a7f5-76864dbdddda admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.745766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 791/1573] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:30.747170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c9e91-7645-4444-98f6-6a4de1fee328 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.762653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c9e91-7645-4444-98f6-6a4de1fee328 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.769327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34b67-de11-423a-bfbb-192c97c1dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.770536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34b67-de11-423a-bfbb-192c97c1dab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.770910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34b67-de11-423a-bfbb-192c97c1dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.771391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34b67-de11-423a-bfbb-192c97c1dab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.773193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b34b67-de11-423a-bfbb-192c97c1dab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.775860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b34b67-de11-423a-bfbb-192c97c1dab9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.800340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 792/1574] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:30.800340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34b67-de11-423a-bfbb-192c97c1dab9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:30.814130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b34b67-de11-423a-bfbb-192c97c1dab9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:30.820511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd696-a15b-4320-94a9-4aece3aceeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.821412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd696-a15b-4320-94a9-4aece3aceeef admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.821705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd696-a15b-4320-94a9-4aece3aceeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.821992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd696-a15b-4320-94a9-4aece3aceeef admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.822886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cd696-a15b-4320-94a9-4aece3aceeef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.827676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cd696-a15b-4320-94a9-4aece3aceeef admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.831216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:30.911939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:30.927891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524265f-1dad-4eb2-9dea-2eb574b798d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:30.929632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524265f-1dad-4eb2-9dea-2eb574b798d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:30.929632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524265f-1dad-4eb2-9dea-2eb574b798d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:30.929632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524265f-1dad-4eb2-9dea-2eb574b798d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:30.930104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524265f-1dad-4eb2-9dea-2eb574b798d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:30.932096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524265f-1dad-4eb2-9dea-2eb574b798d9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:30.966624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 793/1575] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:30 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:30.968612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd696-a15b-4320-94a9-4aece3aceeef admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.072574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd696-a15b-4320-94a9-4aece3aceeef admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.077957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2b05e-4a2d-48cd-b801-cbf39ac0b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.078858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2b05e-4a2d-48cd-b801-cbf39ac0b48d admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.079226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2b05e-4a2d-48cd-b801-cbf39ac0b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.079636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2b05e-4a2d-48cd-b801-cbf39ac0b48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.080498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2b05e-4a2d-48cd-b801-cbf39ac0b48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.082259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2b05e-4a2d-48cd-b801-cbf39ac0b48d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.098127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 794/1576] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:31.098127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2b05e-4a2d-48cd-b801-cbf39ac0b48d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.101995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 783/1577] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:30 2022] POST /identity/v3/projects => generated 377 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:31.103130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524265f-1dad-4eb2-9dea-2eb574b798d9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.110405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2b05e-4a2d-48cd-b801-cbf39ac0b48d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.196540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524265f-1dad-4eb2-9dea-2eb574b798d9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.204718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50546b06-5b3a-4ca9-a28b-5bbcad50d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.204718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546b06-5b3a-4ca9-a28b-5bbcad50d1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.204718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546b06-5b3a-4ca9-a28b-5bbcad50d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.204718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50546b06-5b3a-4ca9-a28b-5bbcad50d1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.211581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50546b06-5b3a-4ca9-a28b-5bbcad50d1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.211581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50546b06-5b3a-4ca9-a28b-5bbcad50d1f3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.211957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b107-4a30-406f-ac2e-934cd7420119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.211957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b107-4a30-406f-ac2e-934cd7420119 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.211957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b107-4a30-406f-ac2e-934cd7420119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.211957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b107-4a30-406f-ac2e-934cd7420119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.212537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b107-4a30-406f-ac2e-934cd7420119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.215012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b107-4a30-406f-ac2e-934cd7420119 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.315876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 784/1578] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:31 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:31.318031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248aee-aa88-4e7c-bb51-a9cb6cfe41ef None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.318542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248aee-aa88-4e7c-bb51-a9cb6cfe41ef None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.318937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248aee-aa88-4e7c-bb51-a9cb6cfe41ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.360727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f7248aee-aa88-4e7c-bb51-a9cb6cfe41ef None None] MFA Rules not processed for user `d9af2154918a4c1fbee9f2ab67bee7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:31.362732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f7248aee-aa88-4e7c-bb51-a9cb6cfe41ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:31.403282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 795/1579] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:31 2022] POST /identity/v3/projects => generated 393 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:31.404581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b107-4a30-406f-ac2e-934cd7420119 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.462128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 785/1580] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:31.463037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248aee-aa88-4e7c-bb51-a9cb6cfe41ef None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.477919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248aee-aa88-4e7c-bb51-a9cb6cfe41ef None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.497527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b107-4a30-406f-ac2e-934cd7420119 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.502871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.503557 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.503838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.504116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.504851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:31.505197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.507537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.516771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:31.520376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 796/1581] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:31.521150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.531819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cd269-e19c-4619-95c7-87a828be161b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.537507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd73b3f-846b-4f8e-9539-090078d7401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.538707 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73b3f-846b-4f8e-9539-090078d7401f admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.539295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73b3f-846b-4f8e-9539-090078d7401f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.539906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd73b3f-846b-4f8e-9539-090078d7401f admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.541372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd73b3f-846b-4f8e-9539-090078d7401f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.545391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd73b3f-846b-4f8e-9539-090078d7401f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.557143 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:31.574327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a38c3-216c-4400-91a7-2a1db1b0f4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.578000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a38c3-216c-4400-91a7-2a1db1b0f4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.578000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a38c3-216c-4400-91a7-2a1db1b0f4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.578000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a38c3-216c-4400-91a7-2a1db1b0f4b9 admin admin] PATH_INFO: `/v3/projects/94a38e607db04e36a734e5074aa2bc92/users/d9bd65bd93b645a79fb728e115bc99b6/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.601197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a38c3-216c-4400-91a7-2a1db1b0f4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a38e607db04e36a734e5074aa2bc92, user_id=d9bd65bd93b645a79fb728e115bc99b6, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.606400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a38c3-216c-4400-91a7-2a1db1b0f4b9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.696598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 797/1582] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:31 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:31.698015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd73b3f-846b-4f8e-9539-090078d7401f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.713567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd73b3f-846b-4f8e-9539-090078d7401f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.718701 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b7d01-8832-4721-be2a-d6706374498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.719427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7d01-8832-4721-be2a-d6706374498e admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.719715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7d01-8832-4721-be2a-d6706374498e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.720043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7d01-8832-4721-be2a-d6706374498e admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.721019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b7d01-8832-4721-be2a-d6706374498e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.722982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b7d01-8832-4721-be2a-d6706374498e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.735013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 786/1583] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:31 2022] PUT /identity/v3/projects/94a38e607db04e36a734e5074aa2bc92/users/d9bd65bd93b645a79fb728e115bc99b6/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:31.736486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a38c3-216c-4400-91a7-2a1db1b0f4b9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.741040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 798/1584] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:31.743606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b7d01-8832-4721-be2a-d6706374498e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.756162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b7d01-8832-4721-be2a-d6706374498e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.823661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a38c3-216c-4400-91a7-2a1db1b0f4b9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.829784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692d03-7a0c-4f02-944d-9c66543f4893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.830510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692d03-7a0c-4f02-944d-9c66543f4893 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.830857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692d03-7a0c-4f02-944d-9c66543f4893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.837974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692d03-7a0c-4f02-944d-9c66543f4893 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.837974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a692d03-7a0c-4f02-944d-9c66543f4893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.837974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a692d03-7a0c-4f02-944d-9c66543f4893 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.839424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6c4c5-67f6-44cf-9380-1b1ad44cfbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.841582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6c4c5-67f6-44cf-9380-1b1ad44cfbef admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.841968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6c4c5-67f6-44cf-9380-1b1ad44cfbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.842284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6c4c5-67f6-44cf-9380-1b1ad44cfbef admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.843841 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6c4c5-67f6-44cf-9380-1b1ad44cfbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.844941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6c4c5-67f6-44cf-9380-1b1ad44cfbef admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.862369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 799/1585] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:31.863339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6c4c5-67f6-44cf-9380-1b1ad44cfbef admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.876237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6c4c5-67f6-44cf-9380-1b1ad44cfbef admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:31.881260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f0bdf-7da0-418b-b7ad-6a37e4e8b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:31.881990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0bdf-7da0-418b-b7ad-6a37e4e8b85d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:31.882302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0bdf-7da0-418b-b7ad-6a37e4e8b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:31.882586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f0bdf-7da0-418b-b7ad-6a37e4e8b85d admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:31.883298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f0bdf-7da0-418b-b7ad-6a37e4e8b85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:31.885210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f0bdf-7da0-418b-b7ad-6a37e4e8b85d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:31.997219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 800/1586] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:31 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:31.997642 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 787/1587] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:31 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:31.998514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692d03-7a0c-4f02-944d-9c66543f4893 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:31.999886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fddbb1-1722-490c-a0e6-74bb29251102 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.000181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fddbb1-1722-490c-a0e6-74bb29251102 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.000467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fddbb1-1722-490c-a0e6-74bb29251102 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.002143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 801/1588] 10.222.0.36 () {54 vars in 961 bytes} [Wed Jun 22 09:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:32.002593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fddbb1-1722-490c-a0e6-74bb29251102 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.017059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692d03-7a0c-4f02-944d-9c66543f4893 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.021959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fddbb1-1722-490c-a0e6-74bb29251102 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.023437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b043e-7666-4723-813c-5e246a6ed6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.024473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b043e-7666-4723-813c-5e246a6ed6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.025068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b043e-7666-4723-813c-5e246a6ed6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.027805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b043e-7666-4723-813c-5e246a6ed6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.027973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb85844-90b5-48de-ba0d-381e04236095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.028531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b043e-7666-4723-813c-5e246a6ed6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.028666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85844-90b5-48de-ba0d-381e04236095 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.028808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85844-90b5-48de-ba0d-381e04236095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.029088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb85844-90b5-48de-ba0d-381e04236095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.029820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb85844-90b5-48de-ba0d-381e04236095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.030638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b043e-7666-4723-813c-5e246a6ed6a4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.031425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb85844-90b5-48de-ba0d-381e04236095 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.052982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 802/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:32.052982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb85844-90b5-48de-ba0d-381e04236095 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.070731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb85844-90b5-48de-ba0d-381e04236095 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.077346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031c0fa-3473-40ce-86ac-c4c073562d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.078564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031c0fa-3473-40ce-86ac-c4c073562d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.079012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031c0fa-3473-40ce-86ac-c4c073562d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.079427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031c0fa-3473-40ce-86ac-c4c073562d64 admin admin] PATH_INFO: `/v3/projects/3c906f2149774a18b39228b7b6ef556f/users/cf981e5982644d708ddaba93a12b2b27/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.102471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031c0fa-3473-40ce-86ac-c4c073562d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c906f2149774a18b39228b7b6ef556f, user_id=cf981e5982644d708ddaba93a12b2b27, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.107679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031c0fa-3473-40ce-86ac-c4c073562d64 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.141341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 788/1590] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:31 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:32.143088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cef06-b2b1-4c2a-a757-043936a249b1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.147034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cef06-b2b1-4c2a-a757-043936a249b1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.147034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cef06-b2b1-4c2a-a757-043936a249b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.176460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f55cef06-b2b1-4c2a-a757-043936a249b1 None None] MFA Rules not processed for user `d9bd65bd93b645a79fb728e115bc99b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:32.177737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f55cef06-b2b1-4c2a-a757-043936a249b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:32.245629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 803/1591] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:32 2022] PUT /identity/v3/projects/3c906f2149774a18b39228b7b6ef556f/users/cf981e5982644d708ddaba93a12b2b27/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:32.247604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031c0fa-3473-40ce-86ac-c4c073562d64 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.270815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 789/1592] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:32.272041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cef06-b2b1-4c2a-a757-043936a249b1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.339346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:32.358816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031c0fa-3473-40ce-86ac-c4c073562d64 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.365339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c68543-3630-4a24-9bda-e4a526eb7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.366045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c68543-3630-4a24-9bda-e4a526eb7a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.366991 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c68543-3630-4a24-9bda-e4a526eb7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.367335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c68543-3630-4a24-9bda-e4a526eb7a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.368147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c68543-3630-4a24-9bda-e4a526eb7a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.369735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c68543-3630-4a24-9bda-e4a526eb7a94 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.387292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 804/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:32.388579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c68543-3630-4a24-9bda-e4a526eb7a94 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.399200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cef06-b2b1-4c2a-a757-043936a249b1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.403447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c68543-3630-4a24-9bda-e4a526eb7a94 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.404344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98779e41-b67b-4d6e-9ce6-1b9814f51419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.405036 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779e41-b67b-4d6e-9ce6-1b9814f51419 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.405410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779e41-b67b-4d6e-9ce6-1b9814f51419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.405693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779e41-b67b-4d6e-9ce6-1b9814f51419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.406457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98779e41-b67b-4d6e-9ce6-1b9814f51419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.416675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98779e41-b67b-4d6e-9ce6-1b9814f51419 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.416910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae3ed-59df-45d7-b484-21253447d09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.416910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae3ed-59df-45d7-b484-21253447d09f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.416910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae3ed-59df-45d7-b484-21253447d09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.416910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fae3ed-59df-45d7-b484-21253447d09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.417319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fae3ed-59df-45d7-b484-21253447d09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.417319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fae3ed-59df-45d7-b484-21253447d09f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.419765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:32.421160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 790/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:32.422984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab15e-dd39-4faa-af4a-14dd85872bb0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.423483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab15e-dd39-4faa-af4a-14dd85872bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.423962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ab15e-dd39-4faa-af4a-14dd85872bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.429659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 805/1595] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:32.430791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae3ed-59df-45d7-b484-21253447d09f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.452148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fae3ed-59df-45d7-b484-21253447d09f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.462492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3e2ab15e-dd39-4faa-af4a-14dd85872bb0 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:32.462492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3e2ab15e-dd39-4faa-af4a-14dd85872bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:32.462952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0114b3-9b82-4882-a6ef-3a16818d1312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.462952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0114b3-9b82-4882-a6ef-3a16818d1312 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.462952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0114b3-9b82-4882-a6ef-3a16818d1312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.462952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0114b3-9b82-4882-a6ef-3a16818d1312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.464194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0114b3-9b82-4882-a6ef-3a16818d1312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.466474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0114b3-9b82-4882-a6ef-3a16818d1312 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.478346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 806/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:32.479187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0114b3-9b82-4882-a6ef-3a16818d1312 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.492522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0114b3-9b82-4882-a6ef-3a16818d1312 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.497593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc97e8-64fb-45e1-bc24-aebbb9e9456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.498399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc97e8-64fb-45e1-bc24-aebbb9e9456d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.498602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc97e8-64fb-45e1-bc24-aebbb9e9456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.498877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc97e8-64fb-45e1-bc24-aebbb9e9456d admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.499583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc97e8-64fb-45e1-bc24-aebbb9e9456d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.501530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc97e8-64fb-45e1-bc24-aebbb9e9456d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.555323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 791/1597] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Jun 22 09:00:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:32.556853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11c5a8-657c-4adf-a5ac-2806acbf2d61 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.557157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11c5a8-657c-4adf-a5ac-2806acbf2d61 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.557427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11c5a8-657c-4adf-a5ac-2806acbf2d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.577053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7c11c5a8-657c-4adf-a5ac-2806acbf2d61 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:32.578328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7c11c5a8-657c-4adf-a5ac-2806acbf2d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:32.586937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 792/1598] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:32.588463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71052d-121a-4c57-ac61-f06e31eac949 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.588771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71052d-121a-4c57-ac61-f06e31eac949 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.589029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71052d-121a-4c57-ac61-f06e31eac949 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.590767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 793/1599] 10.222.0.36 () {54 vars in 961 bytes} [Wed Jun 22 09:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:32.591702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71052d-121a-4c57-ac61-f06e31eac949 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.605877 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71052d-121a-4c57-ac61-f06e31eac949 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.611396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce1cb-81b9-4774-bb2d-f545defac769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.612454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce1cb-81b9-4774-bb2d-f545defac769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.612737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce1cb-81b9-4774-bb2d-f545defac769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.613016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce1cb-81b9-4774-bb2d-f545defac769 admin admin] PATH_INFO: `/v3/projects/a95165b1185a4bf79c844a90ece03636/users/d267646754734a15b39350774c5b7b65/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.636688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce1cb-81b9-4774-bb2d-f545defac769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95165b1185a4bf79c844a90ece03636, user_id=d267646754734a15b39350774c5b7b65, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.640242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce1cb-81b9-4774-bb2d-f545defac769 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.642752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 807/1600] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:32 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:32.648154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc97e8-64fb-45e1-bc24-aebbb9e9456d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.658374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc97e8-64fb-45e1-bc24-aebbb9e9456d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.663423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7784a6-98fb-4bf9-a759-41da7fdb8ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.664299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7784a6-98fb-4bf9-a759-41da7fdb8ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.664587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7784a6-98fb-4bf9-a759-41da7fdb8ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.664866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7784a6-98fb-4bf9-a759-41da7fdb8ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.665609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7784a6-98fb-4bf9-a759-41da7fdb8ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.667260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7784a6-98fb-4bf9-a759-41da7fdb8ff1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.681959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 808/1601] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:32.683556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7784a6-98fb-4bf9-a759-41da7fdb8ff1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.695088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7784a6-98fb-4bf9-a759-41da7fdb8ff1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.700066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c752d96-d45a-48a8-b131-6fa6a522acae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.700738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752d96-d45a-48a8-b131-6fa6a522acae admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.701050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752d96-d45a-48a8-b131-6fa6a522acae admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.701343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c752d96-d45a-48a8-b131-6fa6a522acae admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.702093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c752d96-d45a-48a8-b131-6fa6a522acae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.703784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c752d96-d45a-48a8-b131-6fa6a522acae admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.716961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 809/1602] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:32.718071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c752d96-d45a-48a8-b131-6fa6a522acae admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.729831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c752d96-d45a-48a8-b131-6fa6a522acae admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.734839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d098994-f6b1-46b9-9d83-df8eac9e3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.735751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d098994-f6b1-46b9-9d83-df8eac9e3d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.736037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d098994-f6b1-46b9-9d83-df8eac9e3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.736564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d098994-f6b1-46b9-9d83-df8eac9e3d59 admin admin] PATH_INFO: `/v3/projects/3a5f9b103c0c480199b17cd359532691/users/e7c4c45155234856925ea151b87e3146/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.754767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d098994-f6b1-46b9-9d83-df8eac9e3d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5f9b103c0c480199b17cd359532691, user_id=e7c4c45155234856925ea151b87e3146, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.758436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d098994-f6b1-46b9-9d83-df8eac9e3d59 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.763382 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 794/1603] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:32 2022] PUT /identity/v3/projects/a95165b1185a4bf79c844a90ece03636/users/d267646754734a15b39350774c5b7b65/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:32.764882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce1cb-81b9-4774-bb2d-f545defac769 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.867375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce1cb-81b9-4774-bb2d-f545defac769 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.874485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d0229-7103-4298-b308-b32bc5ac6661 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.875261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d0229-7103-4298-b308-b32bc5ac6661 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.875579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d0229-7103-4298-b308-b32bc5ac6661 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.875868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d0229-7103-4298-b308-b32bc5ac6661 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.876781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 810/1604] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:32 2022] PUT /identity/v3/projects/3a5f9b103c0c480199b17cd359532691/users/e7c4c45155234856925ea151b87e3146/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:32.877825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d098994-f6b1-46b9-9d83-df8eac9e3d59 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:32.916418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:32.957637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d098994-f6b1-46b9-9d83-df8eac9e3d59 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:32.963728 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb031640-7a44-42e1-8576-7b0b058ce5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:32.964765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb031640-7a44-42e1-8576-7b0b058ce5bc service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.965169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb031640-7a44-42e1-8576-7b0b058ce5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.965564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb031640-7a44-42e1-8576-7b0b058ce5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:32.966643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d0229-7103-4298-b308-b32bc5ac6661 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:32.969473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d0229-7103-4298-b308-b32bc5ac6661 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:32.982877 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 795/1605] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:32.984749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a34f2d-2b71-4dbe-b494-6f99bf7dcffb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:32.985142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a34f2d-2b71-4dbe-b494-6f99bf7dcffb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:32.985559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a34f2d-2b71-4dbe-b494-6f99bf7dcffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.011909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-09a34f2d-2b71-4dbe-b494-6f99bf7dcffb None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:33.013069 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-09a34f2d-2b71-4dbe-b494-6f99bf7dcffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:33.045292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb031640-7a44-42e1-8576-7b0b058ce5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:33.046928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb031640-7a44-42e1-8576-7b0b058ce5bc service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:33.058688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 811/1606] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:33.060045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb031640-7a44-42e1-8576-7b0b058ce5bc service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:33.071969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb031640-7a44-42e1-8576-7b0b058ce5bc service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:33.077473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a65dee-9cd4-47fc-880f-8bc531e1a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:33.079241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65dee-9cd4-47fc-880f-8bc531e1a259 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.079241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65dee-9cd4-47fc-880f-8bc531e1a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.079241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a65dee-9cd4-47fc-880f-8bc531e1a259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.079545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a65dee-9cd4-47fc-880f-8bc531e1a259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:33.081204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a65dee-9cd4-47fc-880f-8bc531e1a259 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:33.099944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 812/1607] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:33.099944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a65dee-9cd4-47fc-880f-8bc531e1a259 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:33.115479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a65dee-9cd4-47fc-880f-8bc531e1a259 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:33.123230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce94101-844b-47b0-b83a-2e7ca88b79a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:33.124774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94101-844b-47b0-b83a-2e7ca88b79a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.125410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94101-844b-47b0-b83a-2e7ca88b79a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.125935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce94101-844b-47b0-b83a-2e7ca88b79a0 admin admin] PATH_INFO: `/v3/projects/d20fd7bac1c94a908fd293fa82c534dc/users/c5c6763ac1ea47da89d3bb29d630b48c/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.134830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 796/1608] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Jun 22 09:00:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:33.135369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a34f2d-2b71-4dbe-b494-6f99bf7dcffb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:33.153241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a34f2d-2b71-4dbe-b494-6f99bf7dcffb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:33.160894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb34f3-e95b-4988-98fa-d56c54f3be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:33.161534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce94101-844b-47b0-b83a-2e7ca88b79a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d20fd7bac1c94a908fd293fa82c534dc, user_id=c5c6763ac1ea47da89d3bb29d630b48c, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:33.162591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb34f3-e95b-4988-98fa-d56c54f3be2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.163737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb34f3-e95b-4988-98fa-d56c54f3be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.164304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb34f3-e95b-4988-98fa-d56c54f3be2e admin admin] PATH_INFO: `/v3/projects/6257cf2b40a84e66a1d77b0b2485c462/users/b6b3995abf0047f4b9bfa7061300567e/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.167835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce94101-844b-47b0-b83a-2e7ca88b79a0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:33.192420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb34f3-e95b-4988-98fa-d56c54f3be2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6257cf2b40a84e66a1d77b0b2485c462, user_id=b6b3995abf0047f4b9bfa7061300567e, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:33.192420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb34f3-e95b-4988-98fa-d56c54f3be2e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:33.274658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:33.289403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 813/1609] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:33 2022] PUT /identity/v3/projects/d20fd7bac1c94a908fd293fa82c534dc/users/c5c6763ac1ea47da89d3bb29d630b48c/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:33.289403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b66de-3ce7-4bdd-bd96-51b33aa46305 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.289403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b66de-3ce7-4bdd-bd96-51b33aa46305 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.289403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b66de-3ce7-4bdd-bd96-51b33aa46305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.328492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 797/1610] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:33 2022] PUT /identity/v3/projects/6257cf2b40a84e66a1d77b0b2485c462/users/b6b3995abf0047f4b9bfa7061300567e/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:33.328492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9928-72bc-43b5-9cb1-6dfdc705e2b7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.328492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9928-72bc-43b5-9cb1-6dfdc705e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.328492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9928-72bc-43b5-9cb1-6dfdc705e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.363351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9a2b66de-3ce7-4bdd-bd96-51b33aa46305 None None] MFA Rules not processed for user `d267646754734a15b39350774c5b7b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:33.364785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9a2b66de-3ce7-4bdd-bd96-51b33aa46305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:33.371991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-eb0a9928-72bc-43b5-9cb1-6dfdc705e2b7 None None] MFA Rules not processed for user `e7c4c45155234856925ea151b87e3146`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:33.373217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-eb0a9928-72bc-43b5-9cb1-6dfdc705e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:33.463673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 814/1611] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:33.464601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b66de-3ce7-4bdd-bd96-51b33aa46305 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:33.484428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 798/1612] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:33.484428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9928-72bc-43b5-9cb1-6dfdc705e2b7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:33.523121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:33.601906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b66de-3ce7-4bdd-bd96-51b33aa46305 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:33.611723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf4bbd-1546-4ffc-a6d5-2c2bd0d63f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:33.613545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf4bbd-1546-4ffc-a6d5-2c2bd0d63f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.613545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf4bbd-1546-4ffc-a6d5-2c2bd0d63f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.613873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf4bbd-1546-4ffc-a6d5-2c2bd0d63f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.615277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf4bbd-1546-4ffc-a6d5-2c2bd0d63f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:33.619389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf4bbd-1546-4ffc-a6d5-2c2bd0d63f08 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:33.633572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9928-72bc-43b5-9cb1-6dfdc705e2b7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:33.643109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ed530-3a78-42e3-87f4-ba5dd62c6863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:33.644004 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ed530-3a78-42e3-87f4-ba5dd62c6863 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.644632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ed530-3a78-42e3-87f4-ba5dd62c6863 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.645274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ed530-3a78-42e3-87f4-ba5dd62c6863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.659176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 815/1613] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:33.661561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e5e5-dd52-48e5-8bc1-3be4f232b96b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.662322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e5e5-dd52-48e5-8bc1-3be4f232b96b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.662717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556e5e5-dd52-48e5-8bc1-3be4f232b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.686964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f556e5e5-dd52-48e5-8bc1-3be4f232b96b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:33.688402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f556e5e5-dd52-48e5-8bc1-3be4f232b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:33.698988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 816/1614] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:33.699380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4018-72b4-4f8c-a32a-504f326a5ce8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.699670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4018-72b4-4f8c-a32a-504f326a5ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.699950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f4018-72b4-4f8c-a32a-504f326a5ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.727139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8b0f4018-72b4-4f8c-a32a-504f326a5ce8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:33.731992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8b0f4018-72b4-4f8c-a32a-504f326a5ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:33.739398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 817/1615] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:33.740727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547d5f-021d-42d8-9c19-9ffc430df705 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.741012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547d5f-021d-42d8-9c19-9ffc430df705 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.741884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547d5f-021d-42d8-9c19-9ffc430df705 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.743567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 818/1616] 10.222.0.36 () {54 vars in 912 bytes} [Wed Jun 22 09:00:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:33.744183 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547d5f-021d-42d8-9c19-9ffc430df705 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:33.758630 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ed530-3a78-42e3-87f4-ba5dd62c6863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:33.762207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ed530-3a78-42e3-87f4-ba5dd62c6863 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:33.768407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547d5f-021d-42d8-9c19-9ffc430df705 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:33.780592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8a1dc-37fc-4c86-b04b-417cd2b1ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:33.780839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 799/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:33.781006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8a1dc-37fc-4c86-b04b-417cd2b1ca80 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.781006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8a1dc-37fc-4c86-b04b-417cd2b1ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.781354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ed530-3a78-42e3-87f4-ba5dd62c6863 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:33.781519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8a1dc-37fc-4c86-b04b-417cd2b1ca80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.783020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8a1dc-37fc-4c86-b04b-417cd2b1ca80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:33.787439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8a1dc-37fc-4c86-b04b-417cd2b1ca80 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:33.798958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ed530-3a78-42e3-87f4-ba5dd62c6863 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:33.830541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606374c4-13f7-46c5-931f-3dd497b1a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:33.830541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606374c4-13f7-46c5-931f-3dd497b1a0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:33.830541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606374c4-13f7-46c5-931f-3dd497b1a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:33.830541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606374c4-13f7-46c5-931f-3dd497b1a0ed admin admin] PATH_INFO: `/v3/projects/5b5a0c04d6c34443b6bde4525b6cbf6f/users/88e9d2ab998443469cca53e1e395d290/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:33.853040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606374c4-13f7-46c5-931f-3dd497b1a0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5a0c04d6c34443b6bde4525b6cbf6f, user_id=88e9d2ab998443469cca53e1e395d290, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:33.859644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606374c4-13f7-46c5-931f-3dd497b1a0ed admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.011043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 800/1618] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:33 2022] PUT /identity/v3/projects/5b5a0c04d6c34443b6bde4525b6cbf6f/users/88e9d2ab998443469cca53e1e395d290/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:34.012054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606374c4-13f7-46c5-931f-3dd497b1a0ed admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.018233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 819/1619] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:33 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:34.024658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8a1dc-37fc-4c86-b04b-417cd2b1ca80 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.143233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606374c4-13f7-46c5-931f-3dd497b1a0ed admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.150483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8a1dc-37fc-4c86-b04b-417cd2b1ca80 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.151854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445333f-ef59-4f11-8ac7-fab23f9dbdc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.153824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445333f-ef59-4f11-8ac7-fab23f9dbdc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.154614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445333f-ef59-4f11-8ac7-fab23f9dbdc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.155374 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445333f-ef59-4f11-8ac7-fab23f9dbdc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.156203 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ef3a-ace9-4d20-9d3f-9e48e0d4e222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.157425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ef3a-ace9-4d20-9d3f-9e48e0d4e222 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.157880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ef3a-ace9-4d20-9d3f-9e48e0d4e222 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.158326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3ef3a-ace9-4d20-9d3f-9e48e0d4e222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.166725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:34.247440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:34.270876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445333f-ef59-4f11-8ac7-fab23f9dbdc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.271864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3ef3a-ace9-4d20-9d3f-9e48e0d4e222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.272954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445333f-ef59-4f11-8ac7-fab23f9dbdc3 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.274316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3ef3a-ace9-4d20-9d3f-9e48e0d4e222 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.288736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 801/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:34.290798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40a8e-0bf5-45ac-8479-c9010b4cf760 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.291136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40a8e-0bf5-45ac-8479-c9010b4cf760 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.291408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb40a8e-0bf5-45ac-8479-c9010b4cf760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.292148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 820/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:34.293472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ef3a-ace9-4d20-9d3f-9e48e0d4e222 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.308582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3ef3a-ace9-4d20-9d3f-9e48e0d4e222 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.314491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370258f-8104-4a7f-a5aa-92e9878c4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.315781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-feb40a8e-0bf5-45ac-8479-c9010b4cf760 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:34.315928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370258f-8104-4a7f-a5aa-92e9878c4c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.315928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370258f-8104-4a7f-a5aa-92e9878c4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.316155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370258f-8104-4a7f-a5aa-92e9878c4c97 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.316865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370258f-8104-4a7f-a5aa-92e9878c4c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.316990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-feb40a8e-0bf5-45ac-8479-c9010b4cf760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:34.319132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370258f-8104-4a7f-a5aa-92e9878c4c97 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.425175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 802/1622] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:00:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:34.426724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e50d4-3dc8-451f-a3c7-1d8cdbeb48b7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.427080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e50d4-3dc8-451f-a3c7-1d8cdbeb48b7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.427433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e50d4-3dc8-451f-a3c7-1d8cdbeb48b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.436915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 821/1623] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:34 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:34.438330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370258f-8104-4a7f-a5aa-92e9878c4c97 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.464230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370258f-8104-4a7f-a5aa-92e9878c4c97 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.470412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ef8d7-423d-45eb-a1d0-60b440baf569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.471141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ef8d7-423d-45eb-a1d0-60b440baf569 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.471377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ef8d7-423d-45eb-a1d0-60b440baf569 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.471662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ef8d7-423d-45eb-a1d0-60b440baf569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.475347 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b89e50d4-3dc8-451f-a3c7-1d8cdbeb48b7 None None] MFA Rules not processed for user `88e9d2ab998443469cca53e1e395d290`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:34.477488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b89e50d4-3dc8-451f-a3c7-1d8cdbeb48b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:34.567826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ef8d7-423d-45eb-a1d0-60b440baf569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.571975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ef8d7-423d-45eb-a1d0-60b440baf569 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.588181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 822/1624] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:34.592822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ef8d7-423d-45eb-a1d0-60b440baf569 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.598841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 803/1625] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:34.601155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e50d4-3dc8-451f-a3c7-1d8cdbeb48b7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.620362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ef8d7-423d-45eb-a1d0-60b440baf569 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.635017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469c923-1c23-4cc6-981e-722e47d69983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.639394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469c923-1c23-4cc6-981e-722e47d69983 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.640313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469c923-1c23-4cc6-981e-722e47d69983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.642012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469c923-1c23-4cc6-981e-722e47d69983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.643922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469c923-1c23-4cc6-981e-722e47d69983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.647346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469c923-1c23-4cc6-981e-722e47d69983 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.673387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 823/1626] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:34.674897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469c923-1c23-4cc6-981e-722e47d69983 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.710306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e50d4-3dc8-451f-a3c7-1d8cdbeb48b7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.715700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f9946-5376-4950-a716-db6fce55ea92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.717025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9946-5376-4950-a716-db6fce55ea92 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.717495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9946-5376-4950-a716-db6fce55ea92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.717925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9946-5376-4950-a716-db6fce55ea92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.734629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f9946-5376-4950-a716-db6fce55ea92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.737653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f9946-5376-4950-a716-db6fce55ea92 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.754189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 804/1627] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:34.755635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e9e4-c758-42e1-b4cf-5739b7bc8d31 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.755955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e9e4-c758-42e1-b4cf-5739b7bc8d31 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.756293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e9e4-c758-42e1-b4cf-5739b7bc8d31 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.757798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 805/1628] 10.222.0.36 () {54 vars in 912 bytes} [Wed Jun 22 09:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:34.758522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2e9e4-c758-42e1-b4cf-5739b7bc8d31 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.774801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2e9e4-c758-42e1-b4cf-5739b7bc8d31 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.783521 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eb277-38b7-404b-a554-a301efc8b159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.784711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb277-38b7-404b-a554-a301efc8b159 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.784711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb277-38b7-404b-a554-a301efc8b159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.785034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eb277-38b7-404b-a554-a301efc8b159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.785757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eb277-38b7-404b-a554-a301efc8b159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.787650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9eb277-38b7-404b-a554-a301efc8b159 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.790461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:34.804856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 806/1629] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:34.806942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589831-085f-412c-9257-5cb48d89c6c0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.807220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589831-085f-412c-9257-5cb48d89c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.807508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589831-085f-412c-9257-5cb48d89c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.812284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469c923-1c23-4cc6-981e-722e47d69983 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.828416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b821a-1de3-4599-9062-79157e331c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.829422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b821a-1de3-4599-9062-79157e331c68 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.829875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b821a-1de3-4599-9062-79157e331c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.831599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b821a-1de3-4599-9062-79157e331c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.836297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e4589831-085f-412c-9257-5cb48d89c6c0 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:34.837730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e4589831-085f-412c-9257-5cb48d89c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:34.855342 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 807/1630] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:00:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:34.857144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4589831-085f-412c-9257-5cb48d89c6c0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:34.871133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b821a-1de3-4599-9062-79157e331c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.872092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4589831-085f-412c-9257-5cb48d89c6c0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:34.874692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b821a-1de3-4599-9062-79157e331c68 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:34.878147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6be70-d8f2-470e-ad89-5bf6b350a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:34.879085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6be70-d8f2-470e-ad89-5bf6b350a973 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:34.879370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6be70-d8f2-470e-ad89-5bf6b350a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:34.882478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6be70-d8f2-470e-ad89-5bf6b350a973 admin admin] PATH_INFO: `/v3/projects/97176f8bb5944311824f5afb069852e7/users/d1ba96a9714a46d685e82e999631a6dd/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:34.902223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 824/1631] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:34.906572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6be70-d8f2-470e-ad89-5bf6b350a973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97176f8bb5944311824f5afb069852e7, user_id=d1ba96a9714a46d685e82e999631a6dd, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:34.909740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6be70-d8f2-470e-ad89-5bf6b350a973 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:35.029644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 808/1632] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:34 2022] PUT /identity/v3/projects/97176f8bb5944311824f5afb069852e7/users/d1ba96a9714a46d685e82e999631a6dd/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:35.044504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f424ac-ea59-4071-8a44-e6d586649c57 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:35.045407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f424ac-ea59-4071-8a44-e6d586649c57 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:35.045407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f424ac-ea59-4071-8a44-e6d586649c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:35.084161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:35.090424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d1f424ac-ea59-4071-8a44-e6d586649c57 None None] MFA Rules not processed for user `d1ba96a9714a46d685e82e999631a6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:35.092723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d1f424ac-ea59-4071-8a44-e6d586649c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:35.265473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 825/1633] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:35.265930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6be70-d8f2-470e-ad89-5bf6b350a973 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:35.383622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6be70-d8f2-470e-ad89-5bf6b350a973 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:35.400106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9464-6161-4ef2-873b-be75c7f1a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:35.402985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9464-6161-4ef2-873b-be75c7f1a170 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:35.404088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9464-6161-4ef2-873b-be75c7f1a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:35.405177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f9464-6161-4ef2-873b-be75c7f1a170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:35.406785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f9464-6161-4ef2-873b-be75c7f1a170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:35.410323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f9464-6161-4ef2-873b-be75c7f1a170 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:35.599593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 809/1634] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:35 2022] POST /identity/v3/projects => generated 385 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:00:35.602112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f424ac-ea59-4071-8a44-e6d586649c57 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:35.666121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f424ac-ea59-4071-8a44-e6d586649c57 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:35.775448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bfd22-c72c-4c0e-b739-90927aa52d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:35.776286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfd22-c72c-4c0e-b739-90927aa52d07 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:35.776689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfd22-c72c-4c0e-b739-90927aa52d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:35.777034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfd22-c72c-4c0e-b739-90927aa52d07 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:35.777824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bfd22-c72c-4c0e-b739-90927aa52d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:35.780027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bfd22-c72c-4c0e-b739-90927aa52d07 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:35.906758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 826/1635] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:35 2022] POST /identity/v3/users => generated 299 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:35.911898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9464-6161-4ef2-873b-be75c7f1a170 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:35.923430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f9464-6161-4ef2-873b-be75c7f1a170 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:35.929306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1649e8-4196-41cb-a315-3e3235c0aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:35.930473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1649e8-4196-41cb-a315-3e3235c0aabf admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:35.930846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1649e8-4196-41cb-a315-3e3235c0aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:35.931151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1649e8-4196-41cb-a315-3e3235c0aabf admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:35.931952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1649e8-4196-41cb-a315-3e3235c0aabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:35.933695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1649e8-4196-41cb-a315-3e3235c0aabf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:35.947524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 810/1636] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:35.953484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bfd22-c72c-4c0e-b739-90927aa52d07 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:35.971514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bfd22-c72c-4c0e-b739-90927aa52d07 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:35.979655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3610-6b6b-4a6b-ba3a-dea84ac724b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:35.981086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3610-6b6b-4a6b-ba3a-dea84ac724b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:35.981575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3610-6b6b-4a6b-ba3a-dea84ac724b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:35.982112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e3610-6b6b-4a6b-ba3a-dea84ac724b8 admin admin] PATH_INFO: `/v3/projects/ff561063a668484d9ec310e6ea8deb1b/users/9c1f095a6a134ac3ba5f841e9e17da3e/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:36.005789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e3610-6b6b-4a6b-ba3a-dea84ac724b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff561063a668484d9ec310e6ea8deb1b, user_id=9c1f095a6a134ac3ba5f841e9e17da3e, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:36.009379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e3610-6b6b-4a6b-ba3a-dea84ac724b8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:36.198227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 827/1637] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:35 2022] PUT /identity/v3/projects/ff561063a668484d9ec310e6ea8deb1b/users/9c1f095a6a134ac3ba5f841e9e17da3e/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:36.204506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1649e8-4196-41cb-a315-3e3235c0aabf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:36.251317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1649e8-4196-41cb-a315-3e3235c0aabf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:36.313415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3610-6b6b-4a6b-ba3a-dea84ac724b8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:36.433648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e3610-6b6b-4a6b-ba3a-dea84ac724b8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:36.451603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b9f00-8289-41d6-861f-88edbbbd897e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:36.466324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b9f00-8289-41d6-861f-88edbbbd897e service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:36.467629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b9f00-8289-41d6-861f-88edbbbd897e service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:36.468621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffea3b-d3f6-4b34-8dbc-522adc4095f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:36.469204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b9f00-8289-41d6-861f-88edbbbd897e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:36.470005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffea3b-d3f6-4b34-8dbc-522adc4095f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:36.471006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffea3b-d3f6-4b34-8dbc-522adc4095f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:36.474664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffea3b-d3f6-4b34-8dbc-522adc4095f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:36.476533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffea3b-d3f6-4b34-8dbc-522adc4095f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:36.479287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffea3b-d3f6-4b34-8dbc-522adc4095f9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:36.516831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 811/1638] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:36.518104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffea3b-d3f6-4b34-8dbc-522adc4095f9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:36.552704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffea3b-d3f6-4b34-8dbc-522adc4095f9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:36.556376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:36.575818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6237e5-4e6c-4c10-9bcc-d38404a49233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:36.580005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6237e5-4e6c-4c10-9bcc-d38404a49233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:36.580005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6237e5-4e6c-4c10-9bcc-d38404a49233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:36.580005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6237e5-4e6c-4c10-9bcc-d38404a49233 admin admin] PATH_INFO: `/v3/projects/ff561063a668484d9ec310e6ea8deb1b/users/9c1f095a6a134ac3ba5f841e9e17da3e/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:36.584772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6237e5-4e6c-4c10-9bcc-d38404a49233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff561063a668484d9ec310e6ea8deb1b, user_id=9c1f095a6a134ac3ba5f841e9e17da3e, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:36.596520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6237e5-4e6c-4c10-9bcc-d38404a49233 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:36.638082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 812/1639] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:36 2022] PUT /identity/v3/projects/ff561063a668484d9ec310e6ea8deb1b/users/9c1f095a6a134ac3ba5f841e9e17da3e/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:36.654614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32644-c125-41a3-b2bf-a1891b604531 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:36.654968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32644-c125-41a3-b2bf-a1891b604531 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:36.655167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32644-c125-41a3-b2bf-a1891b604531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:36.709692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fae32644-c125-41a3-b2bf-a1891b604531 None None] MFA Rules not processed for user `9c1f095a6a134ac3ba5f841e9e17da3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:36.712306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fae32644-c125-41a3-b2bf-a1891b604531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:36.730518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:36.746512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b9f00-8289-41d6-861f-88edbbbd897e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:36.749680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b9f00-8289-41d6-861f-88edbbbd897e service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:36.791344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 828/1640] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:36.942920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 813/1641] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:37.641733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b9f00-8289-41d6-861f-88edbbbd897e service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:37.652874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b9f00-8289-41d6-861f-88edbbbd897e service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:37.800190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6463002-f9fd-439d-9f8f-427ad114d38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:37.800190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6463002-f9fd-439d-9f8f-427ad114d38c service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:37.800190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6463002-f9fd-439d-9f8f-427ad114d38c service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:37.800190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6463002-f9fd-439d-9f8f-427ad114d38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:37.828351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6463002-f9fd-439d-9f8f-427ad114d38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:37.831541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6463002-f9fd-439d-9f8f-427ad114d38c service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:37.873440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 829/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:39.085423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae32644-c125-41a3-b2bf-a1891b604531 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:39.085423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae32644-c125-41a3-b2bf-a1891b604531 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:39.085423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:39.085423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:39.089883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:39.089883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] PATH_INFO: `/v3/users/d9bd65bd93b645a79fb728e115bc99b6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:39.089883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bd65bd93b645a79fb728e115bc99b6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:39.089883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:00:39.089883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jun 22 09:00:39.089883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: Jun 22 09:00:39.089883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:39.426822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bd65bd93b645a79fb728e115bc99b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:39.429122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bd65bd93b645a79fb728e115bc99b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:39.472473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bd65bd93b645a79fb728e115bc99b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:39.477099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bd65bd93b645a79fb728e115bc99b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:39.613904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bd65bd93b645a79fb728e115bc99b6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:39.676569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 814/1643] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:00:38 2022] DELETE /identity/v3/users/d9bd65bd93b645a79fb728e115bc99b6 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:39.684502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16e4a-4930-483a-b733-fe183efc9ebd None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:39.685298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16e4a-4930-483a-b733-fe183efc9ebd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:39.685769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16e4a-4930-483a-b733-fe183efc9ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:39.737002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-39a16e4a-4930-483a-b733-fe183efc9ebd None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:39.739722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-39a16e4a-4930-483a-b733-fe183efc9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:39.927592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 830/1644] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:39.943110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:39.943110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:40.116812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:40.201605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bea51a-ec0c-4bc9-bf65-c53f009bc5c7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:40.228177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:40.229548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:40.234673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:40.236527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:40.293010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:40.307684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:40.356054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 815/1645] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:41.992768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a16e4a-4930-483a-b733-fe183efc9ebd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:42.016822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-39a16e4a-4930-483a-b733-fe183efc9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:42.201546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a16e4a-4930-483a-b733-fe183efc9ebd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:42.207636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9613f-2fa8-4670-89aa-98a815673e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:42.208447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9613f-2fa8-4670-89aa-98a815673e0f service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:42.208788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9613f-2fa8-4670-89aa-98a815673e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:42.209096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9613f-2fa8-4670-89aa-98a815673e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:42.214133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-68b9613f-2fa8-4670-89aa-98a815673e0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:42.227677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:42.415412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9613f-2fa8-4670-89aa-98a815673e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:42.415412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9613f-2fa8-4670-89aa-98a815673e0f service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:42.442846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 831/1646] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:42.540278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:42.543833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:42.604149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46895a-2e20-4e49-b95e-ab81f9ecd229 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:42.634676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:42.635734 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:42.638831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:42.640616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] PATH_INFO: `/v3/projects/94a38e607db04e36a734e5074aa2bc92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:42.643266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a38e607db04e36a734e5074aa2bc92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:42.652627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:43.009114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a38e607db04e36a734e5074aa2bc92', 'request_id': 'req-594158de-30d5-492e-be36-1984c1c621ce'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:43.031859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a38e607db04e36a734e5074aa2bc92', 'request_id': 'req-594158de-30d5-492e-be36-1984c1c621ce'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:43.163927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a38e607db04e36a734e5074aa2bc92', 'request_id': 'req-594158de-30d5-492e-be36-1984c1c621ce'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:43.218425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] The token cache is being invalidate because project 94a38e607db04e36a734e5074aa2bc92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:00:43.218995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:43.221872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:43.232982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 816/1647] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:00:42 2022] DELETE /identity/v3/projects/94a38e607db04e36a734e5074aa2bc92 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:43.241858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b94bf-6e53-46cd-a581-23303b0cb5e0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.243333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b94bf-6e53-46cd-a581-23303b0cb5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.243824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b94bf-6e53-46cd-a581-23303b0cb5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.286634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b28b94bf-6e53-46cd-a581-23303b0cb5e0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:43.291354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b28b94bf-6e53-46cd-a581-23303b0cb5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:43.448486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:43.451119 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:43.493580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 832/1648] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:43.495191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eefd3-ee14-49c5-9e6e-0e1bee0b1a80 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.495492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eefd3-ee14-49c5-9e6e-0e1bee0b1a80 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.495753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eefd3-ee14-49c5-9e6e-0e1bee0b1a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.544218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-043eefd3-ee14-49c5-9e6e-0e1bee0b1a80 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:43.545572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-043eefd3-ee14-49c5-9e6e-0e1bee0b1a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:43.574886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 833/1649] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:43.577260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eefd3-ee14-49c5-9e6e-0e1bee0b1a80 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:43.604496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eefd3-ee14-49c5-9e6e-0e1bee0b1a80 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:43.624873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:43.625977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.625977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.628504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.629297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:43.629779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:43.634624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:43.659977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 834/1650] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:43.665299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:43.678868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce8a33-fe27-4f1b-9daa-3b6b1b94c696 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:43.685425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f6507-cb37-4865-ad88-d7b4ddb51c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:43.686508 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f6507-cb37-4865-ad88-d7b4ddb51c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.686935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f6507-cb37-4865-ad88-d7b4ddb51c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.687411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f6507-cb37-4865-ad88-d7b4ddb51c23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.688285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f6507-cb37-4865-ad88-d7b4ddb51c23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:43.690625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f6507-cb37-4865-ad88-d7b4ddb51c23 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:43.720649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594158de-30d5-492e-be36-1984c1c621ce admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:43.732921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:43.733862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:43.734182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:43.734471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] PATH_INFO: `/v3/users/d9af2154918a4c1fbee9f2ab67bee7dc` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:43.739373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9af2154918a4c1fbee9f2ab67bee7dc)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:43.748458 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:43.931221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 835/1651] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:43 2022] POST /identity/v3/projects => generated 365 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:00:43.935631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f6507-cb37-4865-ad88-d7b4ddb51c23 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:44.073629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f6507-cb37-4865-ad88-d7b4ddb51c23 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:44.087106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:44.087876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:44.088167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:44.097366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:44.097366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:44.097366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:44.108281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:44.172794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9af2154918a4c1fbee9f2ab67bee7dc'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:44.187131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9af2154918a4c1fbee9f2ab67bee7dc'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:44.207660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9af2154918a4c1fbee9f2ab67bee7dc'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:44.208312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9af2154918a4c1fbee9f2ab67bee7dc'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:44.326363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 836/1652] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:43 2022] POST /identity/v3/users => generated 283 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:44.328027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:44.331360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:44.359838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00554784-8a5c-4ccb-b66a-afe50faa17d7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:44.371651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0725d9-2efa-4088-a888-93c0e84dfda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:44.373005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0725d9-2efa-4088-a888-93c0e84dfda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:44.373768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0725d9-2efa-4088-a888-93c0e84dfda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:44.374509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0725d9-2efa-4088-a888-93c0e84dfda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:44.376121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0725d9-2efa-4088-a888-93c0e84dfda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:44.380050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0725d9-2efa-4088-a888-93c0e84dfda8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:44.402679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 837/1653] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:44.407629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0725d9-2efa-4088-a888-93c0e84dfda8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:44.434908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0725d9-2efa-4088-a888-93c0e84dfda8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:44.446117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47767cc6-70a4-4276-a5bc-1735591891f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:44.447298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47767cc6-70a4-4276-a5bc-1735591891f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:44.447834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47767cc6-70a4-4276-a5bc-1735591891f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:44.448511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47767cc6-70a4-4276-a5bc-1735591891f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:44.449981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47767cc6-70a4-4276-a5bc-1735591891f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:44.453536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47767cc6-70a4-4276-a5bc-1735591891f0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:44.481959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 838/1654] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:44.488529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47767cc6-70a4-4276-a5bc-1735591891f0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:44.501620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47767cc6-70a4-4276-a5bc-1735591891f0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:44.507905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d5f46-1313-4aeb-9dcd-eb1744e96642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:44.508751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49dabbf3-616d-4543-8359-cb586558d664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9af2154918a4c1fbee9f2ab67bee7dc'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:44.508940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d5f46-1313-4aeb-9dcd-eb1744e96642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:44.509235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d5f46-1313-4aeb-9dcd-eb1744e96642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:44.509565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d5f46-1313-4aeb-9dcd-eb1744e96642 admin admin] PATH_INFO: `/v3/projects/19da3bbf9bda4a7db5cf625b85e1a8a8/users/825f6a4dd41045c5ac2cbba22ba90b3c/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:44.552533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d5f46-1313-4aeb-9dcd-eb1744e96642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19da3bbf9bda4a7db5cf625b85e1a8a8, user_id=825f6a4dd41045c5ac2cbba22ba90b3c, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:44.557567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d5f46-1313-4aeb-9dcd-eb1744e96642 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:44.567822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 817/1655] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:00:43 2022] DELETE /identity/v3/users/d9af2154918a4c1fbee9f2ab67bee7dc => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:44.586400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000676-84b9-4c9d-9b31-919703fb79b2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:44.587175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000676-84b9-4c9d-9b31-919703fb79b2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:44.588216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000676-84b9-4c9d-9b31-919703fb79b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:44.660226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3a000676-84b9-4c9d-9b31-919703fb79b2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:44.668189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3a000676-84b9-4c9d-9b31-919703fb79b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:44.772932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:44.791308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 839/1656] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:44 2022] PUT /identity/v3/projects/19da3bbf9bda4a7db5cf625b85e1a8a8/users/825f6a4dd41045c5ac2cbba22ba90b3c/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:44.796815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1156-a73a-4e83-81fc-6f240cc2d628 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:44.817316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1156-a73a-4e83-81fc-6f240cc2d628 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:44.817763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1156-a73a-4e83-81fc-6f240cc2d628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:44.932779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-32fb1156-a73a-4e83-81fc-6f240cc2d628 None None] MFA Rules not processed for user `825f6a4dd41045c5ac2cbba22ba90b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:44.935067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-32fb1156-a73a-4e83-81fc-6f240cc2d628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:44.955239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 818/1657] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:44.969781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000676-84b9-4c9d-9b31-919703fb79b2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:44.971392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3a000676-84b9-4c9d-9b31-919703fb79b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:45.118897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000676-84b9-4c9d-9b31-919703fb79b2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:45.127999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 840/1658] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:45.129076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb1156-a73a-4e83-81fc-6f240cc2d628 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:45.276392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963767b6-210d-4add-98e2-6bf3e46660d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:45.277506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963767b6-210d-4add-98e2-6bf3e46660d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:45.278002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963767b6-210d-4add-98e2-6bf3e46660d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:45.278515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963767b6-210d-4add-98e2-6bf3e46660d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:45.321561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb1156-a73a-4e83-81fc-6f240cc2d628 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:45.339457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2277b-1272-4290-bd0b-dd6ed0e92988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:45.340489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2277b-1272-4290-bd0b-dd6ed0e92988 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:45.340845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2277b-1272-4290-bd0b-dd6ed0e92988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:45.341147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2277b-1272-4290-bd0b-dd6ed0e92988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:45.354320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2277b-1272-4290-bd0b-dd6ed0e92988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:45.356407 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2277b-1272-4290-bd0b-dd6ed0e92988 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:45.462014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963767b6-210d-4add-98e2-6bf3e46660d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:45.463719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963767b6-210d-4add-98e2-6bf3e46660d0 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:45.504426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 819/1659] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:00:45.539427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963767b6-210d-4add-98e2-6bf3e46660d0 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:45.540122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 841/1660] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:45 2022] POST /identity/v3/projects => generated 365 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:45.565662 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963767b6-210d-4add-98e2-6bf3e46660d0 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:45.797844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7bb1-2a93-4033-848f-a51ad0121548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:45.800769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7bb1-2a93-4033-848f-a51ad0121548 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:45.801434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7bb1-2a93-4033-848f-a51ad0121548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:45.803934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7bb1-2a93-4033-848f-a51ad0121548 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:45.808323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa7bb1-2a93-4033-848f-a51ad0121548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:45.815053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa7bb1-2a93-4033-848f-a51ad0121548 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:46.050210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 820/1661] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:45 2022] POST /identity/v3/users => generated 289 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:00:46.063849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2277b-1272-4290-bd0b-dd6ed0e92988 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:46.088413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2277b-1272-4290-bd0b-dd6ed0e92988 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:46.131302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd951-a950-49bd-8fc2-1573b732ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:46.132483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd951-a950-49bd-8fc2-1573b732ca4e admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:46.132846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd951-a950-49bd-8fc2-1573b732ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:46.133453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cd951-a950-49bd-8fc2-1573b732ca4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:46.134949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cd951-a950-49bd-8fc2-1573b732ca4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:46.138041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cd951-a950-49bd-8fc2-1573b732ca4e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:46.219548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 842/1662] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:46.220909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7bb1-2a93-4033-848f-a51ad0121548 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:46.233360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7bb1-2a93-4033-848f-a51ad0121548 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:46.251572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3ca5-b191-474d-8b3e-a986daea7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:46.253750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3ca5-b191-474d-8b3e-a986daea7c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:46.254522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3ca5-b191-474d-8b3e-a986daea7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:46.255167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca3ca5-b191-474d-8b3e-a986daea7c95 admin admin] PATH_INFO: `/v3/projects/3526cbf184754645b033b7fd54f791bd/users/497ccc6086e24a91877c8007babbb9a6/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:46.305911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca3ca5-b191-474d-8b3e-a986daea7c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3526cbf184754645b033b7fd54f791bd, user_id=497ccc6086e24a91877c8007babbb9a6, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:46.309862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca3ca5-b191-474d-8b3e-a986daea7c95 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:46.469511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 821/1663] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:46 2022] PUT /identity/v3/projects/3526cbf184754645b033b7fd54f791bd/users/497ccc6086e24a91877c8007babbb9a6/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:46.472725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd951-a950-49bd-8fc2-1573b732ca4e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:46.501170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cd951-a950-49bd-8fc2-1573b732ca4e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:46.658435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac54db-17d2-47a1-9489-f4ba81c132bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:46.660856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac54db-17d2-47a1-9489-f4ba81c132bf admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:46.661176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac54db-17d2-47a1-9489-f4ba81c132bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:46.661460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac54db-17d2-47a1-9489-f4ba81c132bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:46.663345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac54db-17d2-47a1-9489-f4ba81c132bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:46.666872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac54db-17d2-47a1-9489-f4ba81c132bf admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:46.682248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 843/1664] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:46.686657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3ca5-b191-474d-8b3e-a986daea7c95 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:46.701329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca3ca5-b191-474d-8b3e-a986daea7c95 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:46.726523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:46.728011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:46.728502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:46.728990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] PATH_INFO: `/v3/projects/3526cbf184754645b033b7fd54f791bd/users/497ccc6086e24a91877c8007babbb9a6/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:46.741225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3526cbf184754645b033b7fd54f791bd, user_id=497ccc6086e24a91877c8007babbb9a6, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:46.755253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:46.801976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 822/1665] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:46 2022] PUT /identity/v3/projects/3526cbf184754645b033b7fd54f791bd/users/497ccc6086e24a91877c8007babbb9a6/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:46.804515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a1080-fe84-4d4e-9a21-aa5ff69908ff None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:46.804838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a1080-fe84-4d4e-9a21-aa5ff69908ff None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:46.805120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a1080-fe84-4d4e-9a21-aa5ff69908ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:46.867380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b42a1080-fe84-4d4e-9a21-aa5ff69908ff None None] MFA Rules not processed for user `497ccc6086e24a91877c8007babbb9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:46.868675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b42a1080-fe84-4d4e-9a21-aa5ff69908ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:47.008116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 844/1666] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:47.083164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:47.087838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:47.213609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa683b-7940-45c6-b47e-fdf4d38b6dca admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:47.227391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c98a-f3e0-4068-87e6-5e6d4434d343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:47.229516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c98a-f3e0-4068-87e6-5e6d4434d343 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:47.230142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c98a-f3e0-4068-87e6-5e6d4434d343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:47.231748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845c98a-f3e0-4068-87e6-5e6d4434d343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:47.281789 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845c98a-f3e0-4068-87e6-5e6d4434d343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:47.283963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845c98a-f3e0-4068-87e6-5e6d4434d343 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:47.313246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 823/1667] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:47.651413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a1080-fe84-4d4e-9a21-aa5ff69908ff None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:47.658499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b42a1080-fe84-4d4e-9a21-aa5ff69908ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:47.703727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:47.849106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a1080-fe84-4d4e-9a21-aa5ff69908ff None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:47.880760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:47.880760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:47.880760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:47.880760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] PATH_INFO: `/v3/projects/5d68fd77f9ad49c3bf1033cca7472bde` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:47.883258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d68fd77f9ad49c3bf1033cca7472bde)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:47.888173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: WARNING py.warnings [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 09:00:47.888173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: warnings.warn(msg) Jun 22 09:00:47.888173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: Jun 22 09:00:47.893885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c98a-f3e0-4068-87e6-5e6d4434d343 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:47.904168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:47.936958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845c98a-f3e0-4068-87e6-5e6d4434d343 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:47.972086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ace766-7b18-49a0-8b17-173bc1b98ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:47.976849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace766-7b18-49a0-8b17-173bc1b98ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:47.976849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace766-7b18-49a0-8b17-173bc1b98ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:47.976849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace766-7b18-49a0-8b17-173bc1b98ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:48.207113 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ace766-7b18-49a0-8b17-173bc1b98ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:48.223157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ace766-7b18-49a0-8b17-173bc1b98ab2 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:48.229758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 824/1668] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:48.352690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d68fd77f9ad49c3bf1033cca7472bde', 'request_id': 'req-33c5a50c-3053-409d-9bde-1edf181f335f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:48.397526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d68fd77f9ad49c3bf1033cca7472bde', 'request_id': 'req-33c5a50c-3053-409d-9bde-1edf181f335f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:48.412712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d68fd77f9ad49c3bf1033cca7472bde', 'request_id': 'req-33c5a50c-3053-409d-9bde-1edf181f335f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:48.656314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] The token cache is being invalidate because project 5d68fd77f9ad49c3bf1033cca7472bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:00:48.659952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:48.662802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-33c5a50c-3053-409d-9bde-1edf181f335f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:48.672263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 845/1669] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:00:47 2022] DELETE /identity/v3/projects/5d68fd77f9ad49c3bf1033cca7472bde => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:48.682467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58f21-384e-4122-a1c0-49fce54d446a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:48.682467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58f21-384e-4122-a1c0-49fce54d446a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:48.684373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58f21-384e-4122-a1c0-49fce54d446a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:48.739106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-22c58f21-384e-4122-a1c0-49fce54d446a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:48.741558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-22c58f21-384e-4122-a1c0-49fce54d446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:49.108645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 825/1670] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:49.121705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c367cb-1de0-48f7-89e9-b2ee5b168d03 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.122220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c367cb-1de0-48f7-89e9-b2ee5b168d03 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.122703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c367cb-1de0-48f7-89e9-b2ee5b168d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.216362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-56c367cb-1de0-48f7-89e9-b2ee5b168d03 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:49.221198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-56c367cb-1de0-48f7-89e9-b2ee5b168d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:49.254396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 846/1671] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:49.262618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c58f21-384e-4122-a1c0-49fce54d446a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:49.300199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c58f21-384e-4122-a1c0-49fce54d446a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:49.323565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece5242-6c9f-4888-a173-1234c01b28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:49.324943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5242-6c9f-4888-a173-1234c01b28b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.325426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5242-6c9f-4888-a173-1234c01b28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.325908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece5242-6c9f-4888-a173-1234c01b28b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.332048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece5242-6c9f-4888-a173-1234c01b28b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:49.332651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece5242-6c9f-4888-a173-1234c01b28b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:49.340375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece5242-6c9f-4888-a173-1234c01b28b6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:49.387121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 826/1672] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:49.389112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c367cb-1de0-48f7-89e9-b2ee5b168d03 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:49.410609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c367cb-1de0-48f7-89e9-b2ee5b168d03 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:49.436342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9ba75-e1f3-458c-a5bb-12e4546e0189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:49.438663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9ba75-e1f3-458c-a5bb-12e4546e0189 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.439338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9ba75-e1f3-458c-a5bb-12e4546e0189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.440005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9ba75-e1f3-458c-a5bb-12e4546e0189 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.442126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9ba75-e1f3-458c-a5bb-12e4546e0189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:49.448385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9ba75-e1f3-458c-a5bb-12e4546e0189 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:49.511803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21e9eb-9935-465b-9310-9f9339060604 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.512101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21e9eb-9935-465b-9310-9f9339060604 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.512408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21e9eb-9935-465b-9310-9f9339060604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.573805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6e21e9eb-9935-465b-9310-9f9339060604 None None] MFA Rules not processed for user `cf981e5982644d708ddaba93a12b2b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:49.576622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6e21e9eb-9935-465b-9310-9f9339060604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:49.666598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 847/1673] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:49 2022] POST /identity/v3/projects => generated 403 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:49.670670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9ba75-e1f3-458c-a5bb-12e4546e0189 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:49.746100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 827/1674] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:49.767158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21e9eb-9935-465b-9310-9f9339060604 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:49.770988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6e21e9eb-9935-465b-9310-9f9339060604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:49.847451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9ba75-e1f3-458c-a5bb-12e4546e0189 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:49.872206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a75fe-2cba-4806-85b2-89384099a86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:49.876601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a75fe-2cba-4806-85b2-89384099a86e admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:49.877080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a75fe-2cba-4806-85b2-89384099a86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:49.877571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a75fe-2cba-4806-85b2-89384099a86e admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:49.880507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a75fe-2cba-4806-85b2-89384099a86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:49.888299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a75fe-2cba-4806-85b2-89384099a86e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:50.025371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21e9eb-9935-465b-9310-9f9339060604 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:50.109788 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:50.170946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 848/1675] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:49 2022] POST /identity/v3/users => generated 302 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:00:50.176621 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a75fe-2cba-4806-85b2-89384099a86e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:50.190364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28af7e-ac9c-451d-afc8-21afa60b4edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:50.239487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28af7e-ac9c-451d-afc8-21afa60b4edb service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:50.241427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28af7e-ac9c-451d-afc8-21afa60b4edb service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:50.256982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a75fe-2cba-4806-85b2-89384099a86e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:50.257444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28af7e-ac9c-451d-afc8-21afa60b4edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:50.275861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f62d58-4531-409d-8574-d13daff9d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:50.277011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62d58-4531-409d-8574-d13daff9d0ef admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:50.277502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62d58-4531-409d-8574-d13daff9d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:50.277979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f62d58-4531-409d-8574-d13daff9d0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:50.287272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f62d58-4531-409d-8574-d13daff9d0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:50.290768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f62d58-4531-409d-8574-d13daff9d0ef admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:50.315677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 849/1676] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:00:50.326387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f62d58-4531-409d-8574-d13daff9d0ef admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:50.425879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f62d58-4531-409d-8574-d13daff9d0ef admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:50.465383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050d32c-f4b7-4c3e-abc6-f7f5b49d5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:50.476477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d32c-f4b7-4c3e-abc6-f7f5b49d5155 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:50.477134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d32c-f4b7-4c3e-abc6-f7f5b49d5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:50.477635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050d32c-f4b7-4c3e-abc6-f7f5b49d5155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:50.481706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050d32c-f4b7-4c3e-abc6-f7f5b49d5155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:50.523487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050d32c-f4b7-4c3e-abc6-f7f5b49d5155 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:50.569080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 850/1677] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:50.589520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050d32c-f4b7-4c3e-abc6-f7f5b49d5155 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:50.619160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050d32c-f4b7-4c3e-abc6-f7f5b49d5155 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:50.645236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb116-08a3-4d54-8a04-60f12c3facbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:50.646242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb116-08a3-4d54-8a04-60f12c3facbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:50.646647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb116-08a3-4d54-8a04-60f12c3facbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:50.654417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb116-08a3-4d54-8a04-60f12c3facbc admin admin] PATH_INFO: `/v3/projects/bc04472725e94cb9b9ce9c16dac69419/users/d56c60e5a1634af5a2b53e7def0922ed/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:50.731202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28af7e-ac9c-451d-afc8-21afa60b4edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:50.732297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bb116-08a3-4d54-8a04-60f12c3facbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc04472725e94cb9b9ce9c16dac69419, user_id=d56c60e5a1634af5a2b53e7def0922ed, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:50.734297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28af7e-ac9c-451d-afc8-21afa60b4edb service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:50.745531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bb116-08a3-4d54-8a04-60f12c3facbc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:50.838681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 828/1678] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 1064 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:50.946191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 851/1679] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:50 2022] PUT /identity/v3/projects/bc04472725e94cb9b9ce9c16dac69419/users/d56c60e5a1634af5a2b53e7def0922ed/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:50.953958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7958d34-fc00-47dc-ad62-a56f47625d56 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:50.954508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7958d34-fc00-47dc-ad62-a56f47625d56 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:50.955153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7958d34-fc00-47dc-ad62-a56f47625d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:51.022812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d483-6411-49bb-a07a-77e7573cd975 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:51.024147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d483-6411-49bb-a07a-77e7573cd975 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:51.025754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743d483-6411-49bb-a07a-77e7573cd975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:51.091421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:51.095643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d7958d34-fc00-47dc-ad62-a56f47625d56 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:51.102360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d7958d34-fc00-47dc-ad62-a56f47625d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:51.191395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d743d483-6411-49bb-a07a-77e7573cd975 None None] MFA Rules not processed for user `b6b3995abf0047f4b9bfa7061300567e`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:51.192805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d743d483-6411-49bb-a07a-77e7573cd975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:51.337741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 829/1680] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:51.345155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7958d34-fc00-47dc-ad62-a56f47625d56 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:51.347946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d7958d34-fc00-47dc-ad62-a56f47625d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:51.403226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7958d34-fc00-47dc-ad62-a56f47625d56 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:51.422569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:51.423538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:51.425840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:51.426249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] PATH_INFO: `/v3/users/e7c4c45155234856925ea151b87e3146` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:51.435937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c4c45155234856925ea151b87e3146)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:51.443005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:51.464656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 852/1681] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:51.466327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d483-6411-49bb-a07a-77e7573cd975 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:51.469314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d743d483-6411-49bb-a07a-77e7573cd975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:51.743086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743d483-6411-49bb-a07a-77e7573cd975 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:51.753808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1ff78-2f1c-435c-a24d-51bed2e7620c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:51.755032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1ff78-2f1c-435c-a24d-51bed2e7620c service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:51.755541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1ff78-2f1c-435c-a24d-51bed2e7620c service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:51.756077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1ff78-2f1c-435c-a24d-51bed2e7620c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:51.769005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1ff78-2f1c-435c-a24d-51bed2e7620c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:51.774908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1ff78-2f1c-435c-a24d-51bed2e7620c service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:51.789392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 853/1682] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:51.793377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64966-f54d-4eb2-88b8-50d84f578fe5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:51.794165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64966-f54d-4eb2-88b8-50d84f578fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:51.794647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c64966-f54d-4eb2-88b8-50d84f578fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:51.819472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-04c64966-f54d-4eb2-88b8-50d84f578fe5 None None] MFA Rules not processed for user `b6b3995abf0047f4b9bfa7061300567e`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:51.821387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-04c64966-f54d-4eb2-88b8-50d84f578fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:51.845881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 854/1683] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:51.861441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c64966-f54d-4eb2-88b8-50d84f578fe5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:51.862959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-04c64966-f54d-4eb2-88b8-50d84f578fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:51.961730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c4c45155234856925ea151b87e3146'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:51.963616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c4c45155234856925ea151b87e3146'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:51.988637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c64966-f54d-4eb2-88b8-50d84f578fe5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:51.996534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c4c45155234856925ea151b87e3146'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:51.998977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c4c45155234856925ea151b87e3146'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:52.012380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861b8b8-7daa-4fc3-b80f-353383e4bad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:52.013215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b8b8-7daa-4fc3-b80f-353383e4bad4 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:52.013508 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b8b8-7daa-4fc3-b80f-353383e4bad4 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:52.013792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b8b8-7daa-4fc3-b80f-353383e4bad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:52.020240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3861b8b8-7daa-4fc3-b80f-353383e4bad4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:52.088767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861b8b8-7daa-4fc3-b80f-353383e4bad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:52.092980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861b8b8-7daa-4fc3-b80f-353383e4bad4 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:52.158442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 855/1684] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:00:52.166011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e14ae3-eb4a-4680-99c9-6f200ba85086 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:52.170725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e14ae3-eb4a-4680-99c9-6f200ba85086 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:52.176564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0b87c61c-060b-4c29-a028-a837de88ee86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c4c45155234856925ea151b87e3146'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:52.178561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e14ae3-eb4a-4680-99c9-6f200ba85086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:52.283359 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 830/1685] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:00:51 2022] DELETE /identity/v3/users/e7c4c45155234856925ea151b87e3146 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:52.291776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7666bf-b522-43c5-ae2c-55adccae2af7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:52.292977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7666bf-b522-43c5-ae2c-55adccae2af7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:52.296320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7666bf-b522-43c5-ae2c-55adccae2af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:52.364494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-46e14ae3-eb4a-4680-99c9-6f200ba85086 None None] MFA Rules not processed for user `c5c6763ac1ea47da89d3bb29d630b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:52.367117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-46e14ae3-eb4a-4680-99c9-6f200ba85086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:52.423580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8e7666bf-b522-43c5-ae2c-55adccae2af7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:52.424921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8e7666bf-b522-43c5-ae2c-55adccae2af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:52.726778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 856/1686] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:52.734995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c384-85e3-4499-b840-bb8df60c37ae None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:52.736023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c384-85e3-4499-b840-bb8df60c37ae None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:52.736928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c384-85e3-4499-b840-bb8df60c37ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:52.775587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9027c384-85e3-4499-b840-bb8df60c37ae None None] MFA Rules not processed for user `c5c6763ac1ea47da89d3bb29d630b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:52.785094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9027c384-85e3-4499-b840-bb8df60c37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:52.842177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 831/1687] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:52.843505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 857/1688] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:52.867166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7666bf-b522-43c5-ae2c-55adccae2af7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:52.869293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8e7666bf-b522-43c5-ae2c-55adccae2af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:52.871525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027c384-85e3-4499-b840-bb8df60c37ae None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:52.874186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9027c384-85e3-4499-b840-bb8df60c37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:53.096680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7666bf-b522-43c5-ae2c-55adccae2af7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:53.098271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027c384-85e3-4499-b840-bb8df60c37ae None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:53.111923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:53.113124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:53.113599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:53.114622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:53.117609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:53.118324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:53.118634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:53.119150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:53.136420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:53.143554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:53.159095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:53.169935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:53.178561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 832/1689] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:00:53.179927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:53.181813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:53.210774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 858/1690] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:53.418369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e913-ba9a-4f7e-b0bf-2e328f7f6e23 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:53.435079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:53.436428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:53.436905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:53.437435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:53.442178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:53.653554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:53.656207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:53.676204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:53.705322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 833/1691] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:53.923872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:54.092733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:54.095245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:54.199120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ce687-7348-4c5b-96eb-b07e92781320 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:54.223440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:54.230695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.230983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.238319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] PATH_INFO: `/v3/projects/3a5f9b103c0c480199b17cd359532691` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.248175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5f9b103c0c480199b17cd359532691)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:54.256080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:54.307270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:54.309753 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:54.346561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6688536-ce69-4544-b4b8-93e0da29eef9 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:54.368438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:54.371225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.371514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.371797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] PATH_INFO: `/v3/users/88e9d2ab998443469cca53e1e395d290` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.377939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e9d2ab998443469cca53e1e395d290)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:54.385793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:54.567018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5f9b103c0c480199b17cd359532691', 'request_id': 'req-8ed3995a-1f18-4915-8f14-b5906735880a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.579118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5f9b103c0c480199b17cd359532691', 'request_id': 'req-8ed3995a-1f18-4915-8f14-b5906735880a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.589555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5f9b103c0c480199b17cd359532691', 'request_id': 'req-8ed3995a-1f18-4915-8f14-b5906735880a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.682001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e9d2ab998443469cca53e1e395d290'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.683414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e9d2ab998443469cca53e1e395d290'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.695311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] The token cache is being invalidate because project 3a5f9b103c0c480199b17cd359532691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:00:54.695614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.697753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8ed3995a-1f18-4915-8f14-b5906735880a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.700511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 859/1692] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:00:54 2022] DELETE /identity/v3/projects/3a5f9b103c0c480199b17cd359532691 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:00:54.702295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c833e-6922-4644-91db-28f1ec7da571 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.702587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c833e-6922-4644-91db-28f1ec7da571 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.702862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c833e-6922-4644-91db-28f1ec7da571 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.711586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 860/1693] 10.222.0.36 () {54 vars in 912 bytes} [Wed Jun 22 09:00:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:54.714394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889cda0-63ee-41b4-adfa-67823cb3b4a6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.715730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889cda0-63ee-41b4-adfa-67823cb3b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.716029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889cda0-63ee-41b4-adfa-67823cb3b4a6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.722355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e9d2ab998443469cca53e1e395d290'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.722825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 861/1694] 10.222.0.36 () {54 vars in 912 bytes} [Wed Jun 22 09:00:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:54.724029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e9d2ab998443469cca53e1e395d290'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.727981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64422-8a2f-4dc9-b66b-24e2aec57f62 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.728354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64422-8a2f-4dc9-b66b-24e2aec57f62 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.728527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64422-8a2f-4dc9-b66b-24e2aec57f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.778216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d2c64422-8a2f-4dc9-b66b-24e2aec57f62 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:54.783234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d2c64422-8a2f-4dc9-b66b-24e2aec57f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:54.850569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6c201fb-1fc4-42f4-92ab-d9ed1b325e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e9d2ab998443469cca53e1e395d290'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:54.904727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 834/1695] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:00:54 2022] DELETE /identity/v3/users/88e9d2ab998443469cca53e1e395d290 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:54.911534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11b865-b3d6-41cd-a319-a0937939b55a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:54.911796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11b865-b3d6-41cd-a319-a0937939b55a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:54.913526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11b865-b3d6-41cd-a319-a0937939b55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:54.990453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7e11b865-b3d6-41cd-a319-a0937939b55a None None] MFA Rules not processed for user `04a07eaeae594cc99cc07da7a4fc6b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:54.991369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7e11b865-b3d6-41cd-a319-a0937939b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:55.060633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 862/1696] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:55.080377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2c57-5dc7-48ff-81b8-92354aea36f3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:55.080786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2c57-5dc7-48ff-81b8-92354aea36f3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:55.081077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2c57-5dc7-48ff-81b8-92354aea36f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:55.179605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-580d2c57-5dc7-48ff-81b8-92354aea36f3 None None] MFA Rules not processed for user `04a07eaeae594cc99cc07da7a4fc6b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:55.180944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-580d2c57-5dc7-48ff-81b8-92354aea36f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:55.182462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 835/1697] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:00:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:55.186646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4264-f643-4ca5-9a43-9d4506c20aff None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:55.186948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4264-f643-4ca5-9a43-9d4506c20aff None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:55.187225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e4264-f643-4ca5-9a43-9d4506c20aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:55.215311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 863/1698] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:00:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:55.217998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ead58-18ec-467f-810f-9043ade2947c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:55.222581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ead58-18ec-467f-810f-9043ade2947c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:55.240678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ead58-18ec-467f-810f-9043ade2947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:55.242086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-490e4264-f643-4ca5-9a43-9d4506c20aff None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:55.248724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-490e4264-f643-4ca5-9a43-9d4506c20aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:55.294935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6f4ead58-18ec-467f-810f-9043ade2947c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:55.296235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6f4ead58-18ec-467f-810f-9043ade2947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:55.448540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 836/1699] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:55.449776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e4264-f643-4ca5-9a43-9d4506c20aff None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:55.452855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-490e4264-f643-4ca5-9a43-9d4506c20aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:55.486948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e4264-f643-4ca5-9a43-9d4506c20aff None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:55.497964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a57bc-2435-4fc3-846a-23116478949a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:55.498669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a57bc-2435-4fc3-846a-23116478949a service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:55.499003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a57bc-2435-4fc3-846a-23116478949a service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:55.499286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a57bc-2435-4fc3-846a-23116478949a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:55.520420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a57bc-2435-4fc3-846a-23116478949a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:55.520420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a57bc-2435-4fc3-846a-23116478949a service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:55.530813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 837/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:55.532223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a57bc-2435-4fc3-846a-23116478949a service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:55.553968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a57bc-2435-4fc3-846a-23116478949a service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:55.558330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e00055-35ef-446d-a812-877d4c3d319d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:55.559001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e00055-35ef-446d-a812-877d4c3d319d service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:55.559330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e00055-35ef-446d-a812-877d4c3d319d service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:55.560234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e00055-35ef-446d-a812-877d4c3d319d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:55.573477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e00055-35ef-446d-a812-877d4c3d319d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:55.575170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e00055-35ef-446d-a812-877d4c3d319d service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:55.579916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 864/1701] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:55.580595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ead58-18ec-467f-810f-9043ade2947c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:55.589277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6f4ead58-18ec-467f-810f-9043ade2947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:55.598675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 838/1702] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:55.600736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e00055-35ef-446d-a812-877d4c3d319d service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:55.616339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e00055-35ef-446d-a812-877d4c3d319d service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:55.622224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:55.622991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:55.623264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:55.623545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:55.624349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:55.624668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:55.625093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ead58-18ec-467f-810f-9043ade2947c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:55.627375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:55.639456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8b87-ebad-43f9-8b43-b8a6c6498db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:55.639456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8b87-ebad-43f9-8b43-b8a6c6498db4 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:55.639456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8b87-ebad-43f9-8b43-b8a6c6498db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:55.639456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c8b87-ebad-43f9-8b43-b8a6c6498db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:55.647317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 839/1703] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:55.651872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:55.655320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8b87-ebad-43f9-8b43-b8a6c6498db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:55.664209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c8b87-ebad-43f9-8b43-b8a6c6498db4 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:55.690052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 865/1704] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:55.695490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6359c-7cb6-45b1-a355-ccb2210e7127 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:55.714406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ba062-40d9-4349-a927-d24a33294d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:55.715040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ba062-40d9-4349-a927-d24a33294d58 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:55.715396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ba062-40d9-4349-a927-d24a33294d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:55.719831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ba062-40d9-4349-a927-d24a33294d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:55.719831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ba062-40d9-4349-a927-d24a33294d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:55.722240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ba062-40d9-4349-a927-d24a33294d58 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:55.863772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 840/1705] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:55 2022] POST /identity/v3/projects => generated 405 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:55.870208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8b87-ebad-43f9-8b43-b8a6c6498db4 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:55.885506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c8b87-ebad-43f9-8b43-b8a6c6498db4 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:56.037568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d4d0b-442b-4655-a9f0-c0733409dab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:56.038464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d4d0b-442b-4655-a9f0-c0733409dab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.038757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d4d0b-442b-4655-a9f0-c0733409dab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.039045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d4d0b-442b-4655-a9f0-c0733409dab1 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:56.041790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:56.042732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d4d0b-442b-4655-a9f0-c0733409dab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:56.044736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d4d0b-442b-4655-a9f0-c0733409dab1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:56.150639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 866/1706] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:55 2022] POST /identity/v3/users => generated 303 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:56.155381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ba062-40d9-4349-a927-d24a33294d58 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:56.180545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ba062-40d9-4349-a927-d24a33294d58 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:56.199962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4a369-6f01-443b-afbf-09a63bcf4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:56.204905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4a369-6f01-443b-afbf-09a63bcf4266 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.207334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4a369-6f01-443b-afbf-09a63bcf4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.210387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4a369-6f01-443b-afbf-09a63bcf4266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:56.213967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4a369-6f01-443b-afbf-09a63bcf4266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:56.213967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4a369-6f01-443b-afbf-09a63bcf4266 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:56.255008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 841/1707] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:56.259921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d4d0b-442b-4655-a9f0-c0733409dab1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:56.338139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d4d0b-442b-4655-a9f0-c0733409dab1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:56.357220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdefd0-c695-4870-af3c-ce61d983245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:56.358097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdefd0-c695-4870-af3c-ce61d983245c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.362078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdefd0-c695-4870-af3c-ce61d983245c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.364926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdefd0-c695-4870-af3c-ce61d983245c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:56.370289 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdefd0-c695-4870-af3c-ce61d983245c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:56.376874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcdefd0-c695-4870-af3c-ce61d983245c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:56.454866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 867/1708] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:56.458203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4a369-6f01-443b-afbf-09a63bcf4266 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:56.487765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4a369-6f01-443b-afbf-09a63bcf4266 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:56.502868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d50c7-467f-4694-a4a4-5655fcee9b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:56.508635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d50c7-467f-4694-a4a4-5655fcee9b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.508944 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d50c7-467f-4694-a4a4-5655fcee9b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.509236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d50c7-467f-4694-a4a4-5655fcee9b48 admin admin] PATH_INFO: `/v3/projects/88142bd82c20419ab4a965104a9e878f/users/b1718e0933254f1da6999d6493ba9437/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:56.568587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d50c7-467f-4694-a4a4-5655fcee9b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88142bd82c20419ab4a965104a9e878f, user_id=b1718e0933254f1da6999d6493ba9437, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:56.590943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d50c7-467f-4694-a4a4-5655fcee9b48 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:56.678590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f17b3-c89a-4495-8c23-ca1fcb1b487e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.679679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f17b3-c89a-4495-8c23-ca1fcb1b487e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.680376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f17b3-c89a-4495-8c23-ca1fcb1b487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:56.722189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 842/1709] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:56 2022] PUT /identity/v3/projects/88142bd82c20419ab4a965104a9e878f/users/b1718e0933254f1da6999d6493ba9437/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:56.730509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1c13-2a13-4186-8590-ffe6b0850dbd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:56.730851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1c13-2a13-4186-8590-ffe6b0850dbd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:56.731134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b1c13-2a13-4186-8590-ffe6b0850dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:56.751714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:56.773230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d86f17b3-c89a-4495-8c23-ca1fcb1b487e None None] MFA Rules not processed for user `d56c60e5a1634af5a2b53e7def0922ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:56.774513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d86f17b3-c89a-4495-8c23-ca1fcb1b487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:56.813028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:56.826265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-725b1c13-2a13-4186-8590-ffe6b0850dbd None None] MFA Rules not processed for user `b1718e0933254f1da6999d6493ba9437`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:56.827200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-725b1c13-2a13-4186-8590-ffe6b0850dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:57.000809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 843/1710] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:57.003595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c754-dbd5-4d80-b519-9f37067df2cf None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.003889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c754-dbd5-4d80-b519-9f37067df2cf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.004166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c754-dbd5-4d80-b519-9f37067df2cf None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.010892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 844/1711] 10.222.0.36 () {54 vars in 960 bytes} [Wed Jun 22 09:00:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:00:57.012192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300c754-dbd5-4d80-b519-9f37067df2cf None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:57.044713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 868/1712] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:00:57.053201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac7ab-8406-4d71-8e65-3a2a966818ff None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.054033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac7ab-8406-4d71-8e65-3a2a966818ff None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.055000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac7ab-8406-4d71-8e65-3a2a966818ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.114355 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d3bac7ab-8406-4d71-8e65-3a2a966818ff None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:57.119218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d3bac7ab-8406-4d71-8e65-3a2a966818ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:57.178430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300c754-dbd5-4d80-b519-9f37067df2cf None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:57.187334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:57.188312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.188816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.189263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.190338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:57.194908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:57.248042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:57.322451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 845/1713] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:57 2022] POST /identity/v3/projects => generated 405 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:57.322451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:57.325433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 869/1714] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Jun 22 09:00:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:57.326593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:57.330607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5d524-0dce-494e-b02f-ab84de890487 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.330886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5d524-0dce-494e-b02f-ab84de890487 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.331171 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5d524-0dce-494e-b02f-ab84de890487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.366136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-55f5d524-0dce-494e-b02f-ab84de890487 None None] MFA Rules not processed for user `c5c6763ac1ea47da89d3bb29d630b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:57.367409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-55f5d524-0dce-494e-b02f-ab84de890487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:57.492190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 870/1715] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:57.492558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5d524-0dce-494e-b02f-ab84de890487 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:57.494017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-55f5d524-0dce-494e-b02f-ab84de890487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:57.504900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919c76a-564b-40f8-a9a6-b35edae02ae9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:57.529752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3646c-624c-4b99-a5a7-e78727befeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:57.530483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3646c-624c-4b99-a5a7-e78727befeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.530770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3646c-624c-4b99-a5a7-e78727befeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.531074 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3646c-624c-4b99-a5a7-e78727befeb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.531756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3646c-624c-4b99-a5a7-e78727befeb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:57.534007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3646c-624c-4b99-a5a7-e78727befeb9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:57.616706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5d524-0dce-494e-b02f-ab84de890487 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:57.635333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:57.645273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.645273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.645273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.645273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:57.654994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:57.656721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:57.678443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 846/1716] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:57 2022] POST /identity/v3/projects => generated 405 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:57.678443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3646c-624c-4b99-a5a7-e78727befeb9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:57.694778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 871/1717] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:57.696209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:57.721470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee675f07-9349-4bb7-9b0f-e11837319bbe service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:57.827316 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3646c-624c-4b99-a5a7-e78727befeb9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:57.835034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43292d26-e7e2-4ff4-a93d-4298674b4711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:57.836197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43292d26-e7e2-4ff4-a93d-4298674b4711 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.836627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43292d26-e7e2-4ff4-a93d-4298674b4711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.837047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43292d26-e7e2-4ff4-a93d-4298674b4711 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.837954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43292d26-e7e2-4ff4-a93d-4298674b4711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:57.852926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43292d26-e7e2-4ff4-a93d-4298674b4711 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:57.889950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:57.892114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.894163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.895902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.917983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:57.933275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:57.959618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 872/1718] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:00:57.965493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:57.966216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 847/1719] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:57 2022] POST /identity/v3/users => generated 309 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:57.967168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:57.968128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7c9b-8dff-46bf-a43d-4256c4041e65 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.969241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7c9b-8dff-46bf-a43d-4256c4041e65 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:57.970709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db7c9b-8dff-46bf-a43d-4256c4041e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:57.992492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac99fc6-e801-4e3a-9f3d-141418420d86 service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:57.998475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:57.999598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:57.999864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:58.000872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] PATH_INFO: `/v3/projects/5b5a0c04d6c34443b6bde4525b6cbf6f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:58.001629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5a0c04d6c34443b6bde4525b6cbf6f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:58.004769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:58.014283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d5db7c9b-8dff-46bf-a43d-4256c4041e65 None None] MFA Rules not processed for user `cf981e5982644d708ddaba93a12b2b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:58.022612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d5db7c9b-8dff-46bf-a43d-4256c4041e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:58.158152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 848/1720] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:58.158152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db7c9b-8dff-46bf-a43d-4256c4041e65 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:58.183025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db7c9b-8dff-46bf-a43d-4256c4041e65 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:58.196689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24871a-bebe-440d-ae75-686c6aa03c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:58.197329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24871a-bebe-440d-ae75-686c6aa03c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:58.197634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24871a-bebe-440d-ae75-686c6aa03c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:58.197975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24871a-bebe-440d-ae75-686c6aa03c13 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:58.198734 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24871a-bebe-440d-ae75-686c6aa03c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:58.200732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24871a-bebe-440d-ae75-686c6aa03c13 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:58.252822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5a0c04d6c34443b6bde4525b6cbf6f', 'request_id': 'req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:58.266726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5a0c04d6c34443b6bde4525b6cbf6f', 'request_id': 'req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:58.278003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5a0c04d6c34443b6bde4525b6cbf6f', 'request_id': 'req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:58.306919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:00:58.314490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 849/1721] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:00:58 2022] POST /identity/v3/users => generated 309 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:00:58.315880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24871a-bebe-440d-ae75-686c6aa03c13 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:58.333028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24871a-bebe-440d-ae75-686c6aa03c13 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:58.402424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] The token cache is being invalidate because project 5b5a0c04d6c34443b6bde4525b6cbf6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:00:58.403285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:58.404680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:00:58.409855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 873/1722] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:00:57 2022] DELETE /identity/v3/projects/5b5a0c04d6c34443b6bde4525b6cbf6f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:58.411650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:58.415803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:58.523578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900fe3d-76f6-44a4-8c70-66f1b12d25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:58.525787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900fe3d-76f6-44a4-8c70-66f1b12d25d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:58.526092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900fe3d-76f6-44a4-8c70-66f1b12d25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:58.526378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900fe3d-76f6-44a4-8c70-66f1b12d25d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:58.530502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900fe3d-76f6-44a4-8c70-66f1b12d25d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:58.533941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900fe3d-76f6-44a4-8c70-66f1b12d25d3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:58.561679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 850/1723] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:58.563631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725131f-401e-4db0-9953-6b9181979c74 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:58.563913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725131f-401e-4db0-9953-6b9181979c74 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:58.564191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725131f-401e-4db0-9953-6b9181979c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:58.595384 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8eb09-34c6-486b-9ea6-5e7f18feeebe admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:58.606032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e725131f-401e-4db0-9953-6b9181979c74 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:58.609404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e725131f-401e-4db0-9953-6b9181979c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:58.611623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049586d8-40ac-44b7-9d65-b0d017a97521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:58.614097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049586d8-40ac-44b7-9d65-b0d017a97521 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:58.614409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049586d8-40ac-44b7-9d65-b0d017a97521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:58.614693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049586d8-40ac-44b7-9d65-b0d017a97521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:58.618476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049586d8-40ac-44b7-9d65-b0d017a97521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:58.623458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049586d8-40ac-44b7-9d65-b0d017a97521 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:58.634092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 851/1724] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:58.642345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725131f-401e-4db0-9953-6b9181979c74 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:58.645885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e725131f-401e-4db0-9953-6b9181979c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:58.661306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 874/1725] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:58.661306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd69f5-b3e4-4cae-88cd-dd37e1e9ffac None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:58.661306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd69f5-b3e4-4cae-88cd-dd37e1e9ffac None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:58.661306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd69f5-b3e4-4cae-88cd-dd37e1e9ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:58.683404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725131f-401e-4db0-9953-6b9181979c74 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:58.688311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9fbd69f5-b3e4-4cae-88cd-dd37e1e9ffac None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:58.689832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9fbd69f5-b3e4-4cae-88cd-dd37e1e9ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:58.694782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48bd1b-9e0a-4215-929a-283c117f1939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:58.695696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48bd1b-9e0a-4215-929a-283c117f1939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:58.695973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48bd1b-9e0a-4215-929a-283c117f1939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:58.696249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48bd1b-9e0a-4215-929a-283c117f1939 admin admin] PATH_INFO: `/v3/projects/4b03583888294c989283cee42320e1dd/users/c2a1ffa3edbc463b8bddb08339eb7196/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:58.701837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 875/1726] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:00:58.702934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd69f5-b3e4-4cae-88cd-dd37e1e9ffac None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:58.716198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd69f5-b3e4-4cae-88cd-dd37e1e9ffac None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:58.721768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ce503-6669-44f9-9cc4-8f7c488479d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:58.722730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce503-6669-44f9-9cc4-8f7c488479d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:58.723017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce503-6669-44f9-9cc4-8f7c488479d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:58.726411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ce503-6669-44f9-9cc4-8f7c488479d5 admin admin] PATH_INFO: `/v3/projects/1f4a5c2909cf4973b9d3f641d7fe0e2c/users/bbaa724be8dc418eb2e331e944976edf/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:58.736697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48bd1b-9e0a-4215-929a-283c117f1939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b03583888294c989283cee42320e1dd, user_id=c2a1ffa3edbc463b8bddb08339eb7196, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:58.749365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48bd1b-9e0a-4215-929a-283c117f1939 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:58.762030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ce503-6669-44f9-9cc4-8f7c488479d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4a5c2909cf4973b9d3f641d7fe0e2c, user_id=bbaa724be8dc418eb2e331e944976edf, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:58.768756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ce503-6669-44f9-9cc4-8f7c488479d5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:58.939761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 852/1727] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:58 2022] PUT /identity/v3/projects/4b03583888294c989283cee42320e1dd/users/c2a1ffa3edbc463b8bddb08339eb7196/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:58.950434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48bd1b-9e0a-4215-929a-283c117f1939 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:58.953450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 876/1728] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:58 2022] PUT /identity/v3/projects/1f4a5c2909cf4973b9d3f641d7fe0e2c/users/bbaa724be8dc418eb2e331e944976edf/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:58.955785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ce503-6669-44f9-9cc4-8f7c488479d5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:59.120036 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48bd1b-9e0a-4215-929a-283c117f1939 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:59.215315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ce503-6669-44f9-9cc4-8f7c488479d5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:59.234532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e603-da5c-4539-abbe-9100c95d88ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:59.235971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e603-da5c-4539-abbe-9100c95d88ea admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.236500 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e603-da5c-4539-abbe-9100c95d88ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.238256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e603-da5c-4539-abbe-9100c95d88ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.238256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323e603-da5c-4539-abbe-9100c95d88ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:59.242649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323e603-da5c-4539-abbe-9100c95d88ea admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:59.322968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 877/1729] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:59.328147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e603-da5c-4539-abbe-9100c95d88ea admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:59.352281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e603-da5c-4539-abbe-9100c95d88ea admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:59.363034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:59.364079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.364453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.364941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.366322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:00:59.366491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963a907-88a4-4fa4-9b7a-32466300e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:59.367145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963a907-88a4-4fa4-9b7a-32466300e85e admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.367715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:59.368186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963a907-88a4-4fa4-9b7a-32466300e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.368708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963a907-88a4-4fa4-9b7a-32466300e85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.369462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:59.370018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963a907-88a4-4fa4-9b7a-32466300e85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:59.373694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963a907-88a4-4fa4-9b7a-32466300e85e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:59.402527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 878/1730] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:00:59.403603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963a907-88a4-4fa4-9b7a-32466300e85e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:59.428932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963a907-88a4-4fa4-9b7a-32466300e85e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:59.451116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 853/1731] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:00:59.451116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:59.452936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80057712-55a6-487e-80fb-5591e35d38ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:59.454012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80057712-55a6-487e-80fb-5591e35d38ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.454475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80057712-55a6-487e-80fb-5591e35d38ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.454878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80057712-55a6-487e-80fb-5591e35d38ad admin admin] PATH_INFO: `/v3/projects/4b03583888294c989283cee42320e1dd/users/c2a1ffa3edbc463b8bddb08339eb7196/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.466585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80057712-55a6-487e-80fb-5591e35d38ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b03583888294c989283cee42320e1dd, user_id=c2a1ffa3edbc463b8bddb08339eb7196, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:59.477924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80057712-55a6-487e-80fb-5591e35d38ad admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:59.496755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d1cc1-cdf9-424a-bb62-019618f14cfb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:59.511657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a9d7a-e9b3-4e71-842f-63feb6508976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:59.512582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9d7a-e9b3-4e71-842f-63feb6508976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.512860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9d7a-e9b3-4e71-842f-63feb6508976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.515265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a9d7a-e9b3-4e71-842f-63feb6508976 admin admin] PATH_INFO: `/v3/projects/1f4a5c2909cf4973b9d3f641d7fe0e2c/users/bbaa724be8dc418eb2e331e944976edf/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.516634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 879/1732] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:59 2022] PUT /identity/v3/projects/4b03583888294c989283cee42320e1dd/users/c2a1ffa3edbc463b8bddb08339eb7196/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:59.526854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80057712-55a6-487e-80fb-5591e35d38ad admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:00:59.527007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a9d7a-e9b3-4e71-842f-63feb6508976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4a5c2909cf4973b9d3f641d7fe0e2c, user_id=bbaa724be8dc418eb2e331e944976edf, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:59.529008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a9d7a-e9b3-4e71-842f-63feb6508976 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:59.544825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 854/1733] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:00:59 2022] PUT /identity/v3/projects/1f4a5c2909cf4973b9d3f641d7fe0e2c/users/bbaa724be8dc418eb2e331e944976edf/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:00:59.546446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c96da2-cec9-4cf3-a1d5-3d7e93112553 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.546873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c96da2-cec9-4cf3-a1d5-3d7e93112553 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.547269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c96da2-cec9-4cf3-a1d5-3d7e93112553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.642977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-74c96da2-cec9-4cf3-a1d5-3d7e93112553 None None] MFA Rules not processed for user `c2a1ffa3edbc463b8bddb08339eb7196`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:00:59.644334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-74c96da2-cec9-4cf3-a1d5-3d7e93112553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:00:59.665475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80057712-55a6-487e-80fb-5591e35d38ad admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:00:59.807038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1aa13-ac1e-49d2-a176-346287d900c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:00:59.825255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1aa13-ac1e-49d2-a176-346287d900c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:00:59.833518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1aa13-ac1e-49d2-a176-346287d900c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:00:59.842318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1aa13-ac1e-49d2-a176-346287d900c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:00:59.844515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1aa13-ac1e-49d2-a176-346287d900c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:00:59.852618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1aa13-ac1e-49d2-a176-346287d900c1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:00:59.863133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 855/1734] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:00:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:00.000173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c96da2-cec9-4cf3-a1d5-3d7e93112553 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:00.002752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-74c96da2-cec9-4cf3-a1d5-3d7e93112553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:00.119552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c96da2-cec9-4cf3-a1d5-3d7e93112553 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:00.133060 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07763fa8-6a81-4d10-a34e-4faa0ce0743e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:00.133834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763fa8-6a81-4d10-a34e-4faa0ce0743e service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:00.134014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763fa8-6a81-4d10-a34e-4faa0ce0743e service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:00.134319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07763fa8-6a81-4d10-a34e-4faa0ce0743e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:00.149945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07763fa8-6a81-4d10-a34e-4faa0ce0743e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:00.152617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07763fa8-6a81-4d10-a34e-4faa0ce0743e service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:00.192319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 856/1735] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:00:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:01:00.242318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 880/1736] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:00:59 2022] POST /identity/v3/projects => generated 381 bytes in 725 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:00.248003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07763fa8-6a81-4d10-a34e-4faa0ce0743e service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:00.274022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07763fa8-6a81-4d10-a34e-4faa0ce0743e service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:00.443815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9272b-e6c2-41ec-82eb-ae015f70e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:00.445372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9272b-e6c2-41ec-82eb-ae015f70e6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:00.451357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9272b-e6c2-41ec-82eb-ae015f70e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:00.451357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9272b-e6c2-41ec-82eb-ae015f70e6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:00.451357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9272b-e6c2-41ec-82eb-ae015f70e6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:00.451357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9272b-e6c2-41ec-82eb-ae015f70e6c4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:00.558331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:00.654165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 857/1737] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:00 2022] POST /identity/v3/users => generated 291 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:00.660963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1aa13-ac1e-49d2-a176-346287d900c1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:00.750496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1aa13-ac1e-49d2-a176-346287d900c1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:00.762885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ce2f-49f7-40a3-b162-1eff86d92d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:00.763629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ce2f-49f7-40a3-b162-1eff86d92d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:00.763914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ce2f-49f7-40a3-b162-1eff86d92d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:00.764360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ce2f-49f7-40a3-b162-1eff86d92d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:00.770436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87ce2f-49f7-40a3-b162-1eff86d92d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:00.775122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87ce2f-49f7-40a3-b162-1eff86d92d0f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:00.828334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 881/1738] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:00.830391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9272b-e6c2-41ec-82eb-ae015f70e6c4 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:00.900076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9272b-e6c2-41ec-82eb-ae015f70e6c4 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:00.915967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43475a91-c2df-4cf1-b99c-433954cfc7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:00.918240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475a91-c2df-4cf1-b99c-433954cfc7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:00.918557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475a91-c2df-4cf1-b99c-433954cfc7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:00.920980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43475a91-c2df-4cf1-b99c-433954cfc7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:00.922750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43475a91-c2df-4cf1-b99c-433954cfc7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:00.932976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43475a91-c2df-4cf1-b99c-433954cfc7c4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:00.973951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 858/1739] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:00.975998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ce2f-49f7-40a3-b162-1eff86d92d0f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:01.000136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ce2f-49f7-40a3-b162-1eff86d92d0f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:01.015091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1479ac-0692-4282-93e3-fc6a0fbd678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:01.016060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1479ac-0692-4282-93e3-fc6a0fbd678d admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:01.016391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1479ac-0692-4282-93e3-fc6a0fbd678d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:01.018761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1479ac-0692-4282-93e3-fc6a0fbd678d admin admin] PATH_INFO: `/v3/projects/0fb52ca6a1ef487d96aebe100f8a8b39/users/7f5fdb1ab82a4195b9057dc27c14b187/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:01.085486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43475a91-c2df-4cf1-b99c-433954cfc7c4 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:01.105562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1479ac-0692-4282-93e3-fc6a0fbd678d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb52ca6a1ef487d96aebe100f8a8b39, user_id=7f5fdb1ab82a4195b9057dc27c14b187, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:01.115880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1479ac-0692-4282-93e3-fc6a0fbd678d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:01.142623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43475a91-c2df-4cf1-b99c-433954cfc7c4 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:01.178171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:01.184039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:01.188977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:01.189273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] PATH_INFO: `/v3/users/b1718e0933254f1da6999d6493ba9437` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:01.202307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1718e0933254f1da6999d6493ba9437)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:01.207889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 882/1740] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:00 2022] PUT /identity/v3/projects/0fb52ca6a1ef487d96aebe100f8a8b39/users/7f5fdb1ab82a4195b9057dc27c14b187/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:01.211977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:01.214949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c804940-4815-4514-9bb9-e68b7fedc680 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:01.215239 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c804940-4815-4514-9bb9-e68b7fedc680 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:01.215864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c804940-4815-4514-9bb9-e68b7fedc680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:01.290464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2c804940-4815-4514-9bb9-e68b7fedc680 None None] MFA Rules not processed for user `7f5fdb1ab82a4195b9057dc27c14b187`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:01.292014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2c804940-4815-4514-9bb9-e68b7fedc680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:01.538846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 883/1741] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:01.549179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c804940-4815-4514-9bb9-e68b7fedc680 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:01.665884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c804940-4815-4514-9bb9-e68b7fedc680 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:01.672434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:01.673439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:01.673901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:01.674296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:01.680718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:01.680718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:01.710120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1718e0933254f1da6999d6493ba9437'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:01.713034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1718e0933254f1da6999d6493ba9437'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:01.741997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1718e0933254f1da6999d6493ba9437'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:01.744297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1718e0933254f1da6999d6493ba9437'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:01.815903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 884/1742] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:01 2022] POST /identity/v3/projects => generated 381 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:01.833091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:01.846439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:01.894022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:01.972301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9015579d-6102-456f-92c4-6d92849bb36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1718e0933254f1da6999d6493ba9437'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:02.040058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf29d-a3c8-41f3-a40b-5a6d60d2c5b3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:02.055199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:02.056741 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:02.058801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:02.059616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:02.061022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 859/1743] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:01 2022] DELETE /identity/v3/users/b1718e0933254f1da6999d6493ba9437 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:02.069589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:02.071634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f3b2-f162-465e-94b9-b810b0ae9de0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:02.074286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f3b2-f162-465e-94b9-b810b0ae9de0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:02.080373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f3b2-f162-465e-94b9-b810b0ae9de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:02.088056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:02.182607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-95a2f3b2-f162-465e-94b9-b810b0ae9de0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:02.185396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-95a2f3b2-f162-465e-94b9-b810b0ae9de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:02.295955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 885/1744] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:01 2022] POST /identity/v3/users => generated 297 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:01:02.297890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:02.300540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:02.329391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b6274-a09a-44cd-978a-4b385960971d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:02.357262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 860/1745] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:02.357262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2f3b2-f162-465e-94b9-b810b0ae9de0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:02.379124 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2f3b2-f162-465e-94b9-b810b0ae9de0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:02.385812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:02.387810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:02.387810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:02.387810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:02.388400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:02.394114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:02.412616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 861/1746] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:02.415469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:02.436131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:02.588593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:02.609909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:02.611705 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:02.612015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:02.612274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] PATH_INFO: `/v3/users/d267646754734a15b39350774c5b7b65` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:02.617847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d267646754734a15b39350774c5b7b65)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:02.623712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:02.654730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d1597-338b-4c16-a38e-8c9708844c77 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:02.665998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc67a0-c3f7-4399-be77-99d506052bae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:02.668959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc67a0-c3f7-4399-be77-99d506052bae service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:02.668959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc67a0-c3f7-4399-be77-99d506052bae service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:02.668959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc67a0-c3f7-4399-be77-99d506052bae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:02.695839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc67a0-c3f7-4399-be77-99d506052bae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:02.700285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc67a0-c3f7-4399-be77-99d506052bae service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:02.728016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 862/1747] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:02.733987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc67a0-c3f7-4399-be77-99d506052bae service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:02.756653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc67a0-c3f7-4399-be77-99d506052bae service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:02.765228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:02.768476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:02.768830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:02.769112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] PATH_INFO: `/v3/projects/f0e3326c5b2243d0b8ae343f4f4d8b75/users/6510a015be0949d68a24e9f006b89f5b/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:02.812048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e3326c5b2243d0b8ae343f4f4d8b75, user_id=6510a015be0949d68a24e9f006b89f5b, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:02.815203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:02.913639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd267646754734a15b39350774c5b7b65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:02.914775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd267646754734a15b39350774c5b7b65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:02.915853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd267646754734a15b39350774c5b7b65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:02.963109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 863/1748] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:02 2022] PUT /identity/v3/projects/f0e3326c5b2243d0b8ae343f4f4d8b75/users/6510a015be0949d68a24e9f006b89f5b/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:02.972167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:02.974558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:03.019187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd267646754734a15b39350774c5b7b65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:03.061925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5d5d7ed-9f29-45da-a920-56f6fb666787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd267646754734a15b39350774c5b7b65'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:03.107041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 886/1749] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:02 2022] DELETE /identity/v3/users/d267646754734a15b39350774c5b7b65 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:03.115746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d54c6-1d99-4442-ae88-f494cc3b8a94 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:03.116262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d54c6-1d99-4442-ae88-f494cc3b8a94 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:03.116755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d54c6-1d99-4442-ae88-f494cc3b8a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:03.152373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ce6d54c6-1d99-4442-ae88-f494cc3b8a94 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:03.158498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ce6d54c6-1d99-4442-ae88-f494cc3b8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:03.262196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4682bb8-3e7c-4c51-a2fc-8b4bc087d9ff admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:03.354586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 887/1750] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:03.367162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d54c6-1d99-4442-ae88-f494cc3b8a94 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:03.369389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ce6d54c6-1d99-4442-ae88-f494cc3b8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:03.397935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026197-5f47-48bb-9ba1-4642007628ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:03.399545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026197-5f47-48bb-9ba1-4642007628ee admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:03.399810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026197-5f47-48bb-9ba1-4642007628ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:03.400215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04026197-5f47-48bb-9ba1-4642007628ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:03.401230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04026197-5f47-48bb-9ba1-4642007628ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:03.426306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04026197-5f47-48bb-9ba1-4642007628ee admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:03.437786 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 864/1751] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:03.443538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026197-5f47-48bb-9ba1-4642007628ee admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:03.527953 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04026197-5f47-48bb-9ba1-4642007628ee admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:03.539536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d54c6-1d99-4442-ae88-f494cc3b8a94 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:03.543721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874ae04-4d04-47ce-80e6-144a5cf48cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:03.548275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874ae04-4d04-47ce-80e6-144a5cf48cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:03.548650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874ae04-4d04-47ce-80e6-144a5cf48cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:03.553216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5d21e-11d1-4455-9123-0da8bb52b363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:03.555441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874ae04-4d04-47ce-80e6-144a5cf48cde admin admin] PATH_INFO: `/v3/projects/f0e3326c5b2243d0b8ae343f4f4d8b75/users/6510a015be0949d68a24e9f006b89f5b/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:03.558346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5d21e-11d1-4455-9123-0da8bb52b363 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:03.558673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5d21e-11d1-4455-9123-0da8bb52b363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:03.559133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5d21e-11d1-4455-9123-0da8bb52b363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:03.563776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874ae04-4d04-47ce-80e6-144a5cf48cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e3326c5b2243d0b8ae343f4f4d8b75, user_id=6510a015be0949d68a24e9f006b89f5b, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:03.580426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874ae04-4d04-47ce-80e6-144a5cf48cde admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:03.587692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5d21e-11d1-4455-9123-0da8bb52b363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:03.588923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5d21e-11d1-4455-9123-0da8bb52b363 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:03.607136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 888/1752] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:03.618968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 865/1753] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:03 2022] PUT /identity/v3/projects/f0e3326c5b2243d0b8ae343f4f4d8b75/users/6510a015be0949d68a24e9f006b89f5b/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:03.633296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984624ac-b800-4df7-bf09-25aa40a43d9a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:03.633801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984624ac-b800-4df7-bf09-25aa40a43d9a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:03.634455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984624ac-b800-4df7-bf09-25aa40a43d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:03.660281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8d834-c2e5-47ea-a21c-004b5c7e6fe4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:03.660778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8d834-c2e5-47ea-a21c-004b5c7e6fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:03.661273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8d834-c2e5-47ea-a21c-004b5c7e6fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:03.670127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:03.689919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-984624ac-b800-4df7-bf09-25aa40a43d9a None None] MFA Rules not processed for user `6510a015be0949d68a24e9f006b89f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:03.693504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-984624ac-b800-4df7-bf09-25aa40a43d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:03.834711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f9e8d834-c2e5-47ea-a21c-004b5c7e6fe4 None None] MFA Rules not processed for user `bbaa724be8dc418eb2e331e944976edf`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:03.836510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f9e8d834-c2e5-47ea-a21c-004b5c7e6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:03.916467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 889/1754] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:03.924983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984624ac-b800-4df7-bf09-25aa40a43d9a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:03.927733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-984624ac-b800-4df7-bf09-25aa40a43d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:04.082656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 866/1755] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:04.084895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8d834-c2e5-47ea-a21c-004b5c7e6fe4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:04.091398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f9e8d834-c2e5-47ea-a21c-004b5c7e6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:04.164935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984624ac-b800-4df7-bf09-25aa40a43d9a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:04.174426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e6784-089d-434e-9ebb-f7cb54459cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:04.175135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e6784-089d-434e-9ebb-f7cb54459cec service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:04.175416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e6784-089d-434e-9ebb-f7cb54459cec service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:04.179024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e6784-089d-434e-9ebb-f7cb54459cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:04.191059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e6784-089d-434e-9ebb-f7cb54459cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:04.193124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e6784-089d-434e-9ebb-f7cb54459cec service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:04.227243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 890/1756] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:01:04.355137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8d834-c2e5-47ea-a21c-004b5c7e6fe4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:04.374294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:04.375302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:04.378136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:04.378518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] PATH_INFO: `/v3/projects/88142bd82c20419ab4a965104a9e878f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:04.385490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88142bd82c20419ab4a965104a9e878f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:04.393771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:04.632665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e6784-089d-434e-9ebb-f7cb54459cec service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:04.649951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e6784-089d-434e-9ebb-f7cb54459cec service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:04.652621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88142bd82c20419ab4a965104a9e878f', 'request_id': 'req-92ab06e2-c9d7-40a6-9321-6929e1b01371'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:04.661100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88142bd82c20419ab4a965104a9e878f', 'request_id': 'req-92ab06e2-c9d7-40a6-9321-6929e1b01371'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:04.763829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88142bd82c20419ab4a965104a9e878f', 'request_id': 'req-92ab06e2-c9d7-40a6-9321-6929e1b01371'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:04.787108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] The token cache is being invalidate because project 88142bd82c20419ab4a965104a9e878f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:04.788276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:04.789561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-92ab06e2-c9d7-40a6-9321-6929e1b01371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:04.792893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 867/1757] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:04 2022] DELETE /identity/v3/projects/88142bd82c20419ab4a965104a9e878f => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:04.800731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137f53-0c32-423e-acba-706853ab4cd0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:04.801021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137f53-0c32-423e-acba-706853ab4cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:04.801300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137f53-0c32-423e-acba-706853ab4cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:04.808053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:04.808723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:04.809015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:04.809284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:04.814724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:04.843710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-35137f53-0c32-423e-acba-706853ab4cd0 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:04.845128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-35137f53-0c32-423e-acba-706853ab4cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:04.979709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:04.981168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:04.999781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 868/1758] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:01:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:05.001449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137f53-0c32-423e-acba-706853ab4cd0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:05.003180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 891/1759] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:05.005465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-35137f53-0c32-423e-acba-706853ab4cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:05.181220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137f53-0c32-423e-acba-706853ab4cd0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:05.194913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:05.196330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:05.196578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:05.197025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] PATH_INFO: `/v3/users/c2a1ffa3edbc463b8bddb08339eb7196` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:05.199351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a1ffa3edbc463b8bddb08339eb7196)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:05.202515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:05.257762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:05.460529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:05.463152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:05.549256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a1ffa3edbc463b8bddb08339eb7196'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:05.549846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a1ffa3edbc463b8bddb08339eb7196'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:05.560170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a1ffa3edbc463b8bddb08339eb7196'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:05.561558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a1ffa3edbc463b8bddb08339eb7196'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:05.694792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a1ffa3edbc463b8bddb08339eb7196'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:05.725021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17ae41-51d5-4e10-92b9-089ded6cb28a service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:05.750547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:05.751683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:05.754540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:05.756688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:05.759634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:05.762984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 869/1760] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:05 2022] DELETE /identity/v3/users/c2a1ffa3edbc463b8bddb08339eb7196 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:05.764102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:05.767764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:05.791043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:05.793071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:05.815895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 892/1761] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:01:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:01:05.847402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:05.849505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:05.867946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ebdf6-9bed-4bfc-9f06-681b87d181f3 service swift] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:05.905857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3f722-66ab-43a1-bc2b-e3c4b0d28c4a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:05.923249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:05.929785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:05.930481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:05.930924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] PATH_INFO: `/v3/users/825f6a4dd41045c5ac2cbba22ba90b3c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:05.935982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825f6a4dd41045c5ac2cbba22ba90b3c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:05.941799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:06.048529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:06.051021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:06.051589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:06.052597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] PATH_INFO: `/v3/projects/a95165b1185a4bf79c844a90ece03636` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:06.054227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95165b1185a4bf79c844a90ece03636)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:06.056358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:06.207788 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825f6a4dd41045c5ac2cbba22ba90b3c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.214114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825f6a4dd41045c5ac2cbba22ba90b3c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.229874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95165b1185a4bf79c844a90ece03636', 'request_id': 'req-a76bb1b6-330a-4885-8e1a-02576675e0e2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.242097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825f6a4dd41045c5ac2cbba22ba90b3c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.242940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825f6a4dd41045c5ac2cbba22ba90b3c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.248478 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95165b1185a4bf79c844a90ece03636', 'request_id': 'req-a76bb1b6-330a-4885-8e1a-02576675e0e2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.257427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95165b1185a4bf79c844a90ece03636', 'request_id': 'req-a76bb1b6-330a-4885-8e1a-02576675e0e2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.765761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-047b0af7-822c-47d6-b6d1-47e617666316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825f6a4dd41045c5ac2cbba22ba90b3c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.765761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 870/1762] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:05 2022] DELETE /identity/v3/users/825f6a4dd41045c5ac2cbba22ba90b3c => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:06.765761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad51e-0e47-45cc-a83a-0904a6e837e7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:06.765761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad51e-0e47-45cc-a83a-0904a6e837e7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:06.765761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad51e-0e47-45cc-a83a-0904a6e837e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:06.790737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e63ad51e-0e47-45cc-a83a-0904a6e837e7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:06.792394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e63ad51e-0e47-45cc-a83a-0904a6e837e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:06.970578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 871/1763] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:01:06.997521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] The token cache is being invalidate because project a95165b1185a4bf79c844a90ece03636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:06.997521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.997521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:06.997521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 893/1764] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:05 2022] DELETE /identity/v3/projects/a95165b1185a4bf79c844a90ece03636 => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:06.998729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad51e-0e47-45cc-a83a-0904a6e837e7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:07.000495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e63ad51e-0e47-45cc-a83a-0904a6e837e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:07.008626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:07.010312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:07.039846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad51e-0e47-45cc-a83a-0904a6e837e7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:07.055493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:07.058591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:07.058948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:07.059195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] PATH_INFO: `/v3/users/d1ba96a9714a46d685e82e999631a6dd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:07.063381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ba96a9714a46d685e82e999631a6dd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:07.065918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:07.191502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bb1b6-330a-4885-8e1a-02576675e0e2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:07.245250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:07.312184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd77cfe-1da7-4efa-843a-353995294715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:07.312927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd77cfe-1da7-4efa-843a-353995294715 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:07.313221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd77cfe-1da7-4efa-843a-353995294715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:07.313502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd77cfe-1da7-4efa-843a-353995294715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:07.317046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0bd77cfe-1da7-4efa-843a-353995294715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:07.355708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd77cfe-1da7-4efa-843a-353995294715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:07.357319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd77cfe-1da7-4efa-843a-353995294715 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:07.358122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ba96a9714a46d685e82e999631a6dd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:07.359068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ba96a9714a46d685e82e999631a6dd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:07.373389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 894/1765] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:07.386475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ba96a9714a46d685e82e999631a6dd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:07.392910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ba96a9714a46d685e82e999631a6dd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:07.473665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-eb6d4398-d671-4301-9b78-4e0c500fb9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ba96a9714a46d685e82e999631a6dd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:07.499700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:07.510087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 872/1766] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:06 2022] DELETE /identity/v3/users/d1ba96a9714a46d685e82e999631a6dd => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:07.923784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ce55-74bf-4aac-af09-a8485798a591 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:07.925863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ce55-74bf-4aac-af09-a8485798a591 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:07.926434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704ce55-74bf-4aac-af09-a8485798a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:07.967475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6704ce55-74bf-4aac-af09-a8485798a591 None None] MFA Rules not processed for user `04a07eaeae594cc99cc07da7a4fc6b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:07.969068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6704ce55-74bf-4aac-af09-a8485798a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:08.118728 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 895/1767] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jun 22 09:01:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:08.121241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8aaa-d789-4562-bd1a-a450335b229e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:08.122032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8aaa-d789-4562-bd1a-a450335b229e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:08.122032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f8aaa-d789-4562-bd1a-a450335b229e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:08.124086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 873/1768] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:08.179460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45e3e-5401-4f9e-8a38-51ddb4949b34 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:08.179898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45e3e-5401-4f9e-8a38-51ddb4949b34 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:08.180362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45e3e-5401-4f9e-8a38-51ddb4949b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:08.219003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b8f45e3e-5401-4f9e-8a38-51ddb4949b34 None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:08.222369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b8f45e3e-5401-4f9e-8a38-51ddb4949b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:08.296141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f8aaa-d789-4562-bd1a-a450335b229e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:08.303170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-195f8aaa-d789-4562-bd1a-a450335b229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:08.346023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f8aaa-d789-4562-bd1a-a450335b229e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:08.354572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:08.355366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:08.355814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:08.356093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:08.365349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:08.366854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:08.389336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 896/1769] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:01:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:01:08.400954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 874/1770] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:01:08.447060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f45e3e-5401-4f9e-8a38-51ddb4949b34 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:08.449234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b8f45e3e-5401-4f9e-8a38-51ddb4949b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:08.469584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f45e3e-5401-4f9e-8a38-51ddb4949b34 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:08.478852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db307-99df-49ba-98c4-6250a4ac110d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:08.479847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db307-99df-49ba-98c4-6250a4ac110d service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:08.480145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db307-99df-49ba-98c4-6250a4ac110d service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:08.480415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db307-99df-49ba-98c4-6250a4ac110d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:08.495205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566db307-99df-49ba-98c4-6250a4ac110d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:08.496827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566db307-99df-49ba-98c4-6250a4ac110d service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:08.534473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 897/1771] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:08.654673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:08.656322 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:08.859653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a02d30-9aca-4bfd-9e4b-82b836f4f508 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:08.867850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:08.869718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:08.870134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:08.870486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] PATH_INFO: `/v3/projects/4b03583888294c989283cee42320e1dd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:08.872179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b03583888294c989283cee42320e1dd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:08.874447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:09.015408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b03583888294c989283cee42320e1dd', 'request_id': 'req-cce19132-46c3-490f-b119-e0176e39b78b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:09.023507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b03583888294c989283cee42320e1dd', 'request_id': 'req-cce19132-46c3-490f-b119-e0176e39b78b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:09.053936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:09.080660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b03583888294c989283cee42320e1dd', 'request_id': 'req-cce19132-46c3-490f-b119-e0176e39b78b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:09.108819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] The token cache is being invalidate because project 4b03583888294c989283cee42320e1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:09.109014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:09.118302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cce19132-46c3-490f-b119-e0176e39b78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:09.120713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 875/1772] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:08 2022] DELETE /identity/v3/projects/4b03583888294c989283cee42320e1dd => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:09.125648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f619b-262f-4819-a0fe-76cbcbd919f2 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:09.125941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f619b-262f-4819-a0fe-76cbcbd919f2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:09.126258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f619b-262f-4819-a0fe-76cbcbd919f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:09.179895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3b6f619b-262f-4819-a0fe-76cbcbd919f2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:09.180362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:09.181638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3b6f619b-262f-4819-a0fe-76cbcbd919f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:09.353376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 898/1773] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:09.354564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b22df-8e00-4d38-8270-3c8b243c6c68 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:09.354862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b22df-8e00-4d38-8270-3c8b243c6c68 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:09.355137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b22df-8e00-4d38-8270-3c8b243c6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:09.398935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0e6b22df-8e00-4d38-8270-3c8b243c6c68 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:09.400480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0e6b22df-8e00-4d38-8270-3c8b243c6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:09.415715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 876/1774] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:01:09.420859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f619b-262f-4819-a0fe-76cbcbd919f2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:09.460525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f619b-262f-4819-a0fe-76cbcbd919f2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:09.461958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:09.463084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:09.463173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:09.463507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:09.464249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:09.464631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:09.466582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:09.541550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b22df-8e00-4d38-8270-3c8b243c6c68 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:09.543499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 899/1775] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:09.561070 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b22df-8e00-4d38-8270-3c8b243c6c68 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:09.578181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:09.579016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:09.579301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:09.579632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:09.580404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:09.593489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:09.812504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 877/1776] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:09 2022] POST /identity/v3/projects => generated 387 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:09.813521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:09.840912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7e56d-f518-4f99-860b-9e0d31ae0d69 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:10.277336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:10.278843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:10.279613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:10.280113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:10.289014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:10.294671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:10.498194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:10.509558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:10.534535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fca0d8-cf7c-444d-8c6c-caefcdfc4f26 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:10.550477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:10.551640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:10.552887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:10.553423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] PATH_INFO: `/v3/projects/97176f8bb5944311824f5afb069852e7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:10.555365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97176f8bb5944311824f5afb069852e7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:10.559164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:10.796778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 900/1777] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:09 2022] POST /identity/v3/users => generated 294 bytes in 984 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:10.798673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:10.808331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:10.842866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8165f5-d033-44a4-97e3-d54a26c8a74a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:10.885499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97176f8bb5944311824f5afb069852e7', 'request_id': 'req-bc18e5aa-4cbe-4550-8554-a29ff8656329'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:10.899020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97176f8bb5944311824f5afb069852e7', 'request_id': 'req-bc18e5aa-4cbe-4550-8554-a29ff8656329'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:10.963014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:10.964390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:10.964820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:10.965298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] PATH_INFO: `/v3/projects/19da3bbf9bda4a7db5cf625b85e1a8a8` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:10.966940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19da3bbf9bda4a7db5cf625b85e1a8a8)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:10.969163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:11.033856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:11.067211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97176f8bb5944311824f5afb069852e7', 'request_id': 'req-bc18e5aa-4cbe-4550-8554-a29ff8656329'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.103274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] The token cache is being invalidate because project 97176f8bb5944311824f5afb069852e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:11.103890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.105512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.117146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 878/1778] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:10 2022] DELETE /identity/v3/projects/97176f8bb5944311824f5afb069852e7 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:11.118643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:11.125118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:11.156151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19da3bbf9bda4a7db5cf625b85e1a8a8', 'request_id': 'req-b6266536-3e58-44da-bffc-fad85b3d6021'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.159931 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e5aa-4cbe-4550-8554-a29ff8656329 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:11.189160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19da3bbf9bda4a7db5cf625b85e1a8a8', 'request_id': 'req-b6266536-3e58-44da-bffc-fad85b3d6021'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.223182 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19da3bbf9bda4a7db5cf625b85e1a8a8', 'request_id': 'req-b6266536-3e58-44da-bffc-fad85b3d6021'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.236308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:11.294218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:11.295130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:11.303698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:11.304269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] PATH_INFO: `/v3/users/d56c60e5a1634af5a2b53e7def0922ed` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:11.308517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56c60e5a1634af5a2b53e7def0922ed)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:11.319351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:11.407753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] The token cache is being invalidate because project 19da3bbf9bda4a7db5cf625b85e1a8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:11.412215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.412215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.412215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 901/1779] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:10 2022] DELETE /identity/v3/projects/19da3bbf9bda4a7db5cf625b85e1a8a8 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:11.412770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:11.416821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:11.460724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6266536-3e58-44da-bffc-fad85b3d6021 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:11.479752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:11.480890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:11.481420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:11.481939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:11.483031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:11.485220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:11.507725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 902/1780] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:11.508616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:11.511764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:11.541436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39bacc-57f4-45e4-a827-d4fa10b68e56 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:11.554242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:11.559221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:11.559221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:11.559221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] PATH_INFO: `/v3/users/9c1f095a6a134ac3ba5f841e9e17da3e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:11.559221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1f095a6a134ac3ba5f841e9e17da3e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:11.562293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:11.677987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56c60e5a1634af5a2b53e7def0922ed'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.686494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56c60e5a1634af5a2b53e7def0922ed'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.712161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56c60e5a1634af5a2b53e7def0922ed'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.713586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56c60e5a1634af5a2b53e7def0922ed'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.886052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56c60e5a1634af5a2b53e7def0922ed'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.906109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1f095a6a134ac3ba5f841e9e17da3e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.907689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1f095a6a134ac3ba5f841e9e17da3e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.907994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1f095a6a134ac3ba5f841e9e17da3e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:11.941986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 879/1781] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:11 2022] DELETE /identity/v3/users/d56c60e5a1634af5a2b53e7def0922ed => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:11.943211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:11.948760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:12.000760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1f095a6a134ac3ba5f841e9e17da3e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:12.030106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1f095a6a134ac3ba5f841e9e17da3e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:12.066019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be3e3-83e5-4b1c-adf2-731e6a29fb47 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:12.080207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 903/1782] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:11 2022] DELETE /identity/v3/users/9c1f095a6a134ac3ba5f841e9e17da3e => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:12.082434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:12.085483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:12.228353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:12.229930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.230660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.231307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] PATH_INFO: `/v3/users/497ccc6086e24a91877c8007babbb9a6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.239509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=497ccc6086e24a91877c8007babbb9a6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:12.244076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:12.272600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060b2ed-d929-4f84-a507-5efaf7816baf admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:12.296131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf68ac-dbbb-445c-ad8e-be2dee4c0b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:12.297287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68ac-dbbb-445c-ad8e-be2dee4c0b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.297799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68ac-dbbb-445c-ad8e-be2dee4c0b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.300520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf68ac-dbbb-445c-ad8e-be2dee4c0b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.301668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf68ac-dbbb-445c-ad8e-be2dee4c0b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:12.325523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf68ac-dbbb-445c-ad8e-be2dee4c0b37 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:12.346315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 904/1783] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:12.349104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b67453-0851-47de-a2c2-aaa1a08c7204 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.349790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b67453-0851-47de-a2c2-aaa1a08c7204 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.350462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b67453-0851-47de-a2c2-aaa1a08c7204 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.352199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 905/1784] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:01:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:12.353169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b67453-0851-47de-a2c2-aaa1a08c7204 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:12.372931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b67453-0851-47de-a2c2-aaa1a08c7204 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:12.378649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577d1d4-9f4e-4cff-9ca2-6dbcb00e0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:12.380451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d1d4-9f4e-4cff-9ca2-6dbcb00e0dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.380913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d1d4-9f4e-4cff-9ca2-6dbcb00e0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.381324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577d1d4-9f4e-4cff-9ca2-6dbcb00e0dfb admin admin] PATH_INFO: `/v3/projects/452186ff420949fe8f4a46556ada5ae4/users/2182e2a1f2ca436eac5357680d97a106/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.408527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d1d4-9f4e-4cff-9ca2-6dbcb00e0dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=452186ff420949fe8f4a46556ada5ae4, user_id=2182e2a1f2ca436eac5357680d97a106, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:12.415615 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577d1d4-9f4e-4cff-9ca2-6dbcb00e0dfb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:12.562214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 906/1785] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:12 2022] PUT /identity/v3/projects/452186ff420949fe8f4a46556ada5ae4/users/2182e2a1f2ca436eac5357680d97a106/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:12.566968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151beba0-accd-48bf-bc70-66951d6770f8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.567206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151beba0-accd-48bf-bc70-66951d6770f8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.567758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151beba0-accd-48bf-bc70-66951d6770f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.589652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497ccc6086e24a91877c8007babbb9a6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:12.592214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497ccc6086e24a91877c8007babbb9a6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:12.612085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497ccc6086e24a91877c8007babbb9a6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:12.612812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497ccc6086e24a91877c8007babbb9a6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:12.630840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-151beba0-accd-48bf-bc70-66951d6770f8 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:12.634974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-151beba0-accd-48bf-bc70-66951d6770f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:12.719996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497ccc6086e24a91877c8007babbb9a6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:12.749016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 880/1786] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:11 2022] DELETE /identity/v3/users/497ccc6086e24a91877c8007babbb9a6 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:12.751413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:12.753428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:12.802267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 907/1787] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:01:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:12.805020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61902a3-3efd-4368-b371-fda4cbe00c02 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.805020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61902a3-3efd-4368-b371-fda4cbe00c02 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.805020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61902a3-3efd-4368-b371-fda4cbe00c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.854388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d61902a3-3efd-4368-b371-fda4cbe00c02 None None] MFA Rules not processed for user `2182e2a1f2ca436eac5357680d97a106`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:12.856697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d61902a3-3efd-4368-b371-fda4cbe00c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:12.908059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599567b1-c09e-4e9b-bc7f-9de6aff4dc8c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:12.916875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:12.918307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:12.918817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:12.919342 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] PATH_INFO: `/v3/projects/bc04472725e94cb9b9ce9c16dac69419` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:12.920993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc04472725e94cb9b9ce9c16dac69419)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:12.923850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:12.978919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 908/1788] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:12.984650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61902a3-3efd-4368-b371-fda4cbe00c02 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:12.990505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d61902a3-3efd-4368-b371-fda4cbe00c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:13.001386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61902a3-3efd-4368-b371-fda4cbe00c02 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:13.007472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dad2d-fe70-4450-80d8-b763525d4483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:13.008124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dad2d-fe70-4450-80d8-b763525d4483 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.008408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dad2d-fe70-4450-80d8-b763525d4483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.008843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dad2d-fe70-4450-80d8-b763525d4483 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.009373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dad2d-fe70-4450-80d8-b763525d4483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:13.011328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dad2d-fe70-4450-80d8-b763525d4483 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:13.126126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc04472725e94cb9b9ce9c16dac69419', 'request_id': 'req-57a2979a-0007-4f04-8779-8028765d0a57'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:13.148553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc04472725e94cb9b9ce9c16dac69419', 'request_id': 'req-57a2979a-0007-4f04-8779-8028765d0a57'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:13.179343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 909/1789] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:12 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:13.193636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dad2d-fe70-4450-80d8-b763525d4483 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:13.249755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc04472725e94cb9b9ce9c16dac69419', 'request_id': 'req-57a2979a-0007-4f04-8779-8028765d0a57'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:13.323296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] The token cache is being invalidate because project bc04472725e94cb9b9ce9c16dac69419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:13.323794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:13.336323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:13.358236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 881/1790] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:12 2022] DELETE /identity/v3/projects/bc04472725e94cb9b9ce9c16dac69419 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:13.358236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:13.358236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:13.358689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dad2d-fe70-4450-80d8-b763525d4483 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:13.367801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:13.368521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.368805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.369580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.374636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:13.377651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:13.513924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2979a-0007-4f04-8779-8028765d0a57 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:13.599976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 910/1791] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:13 2022] POST /identity/v3/users => generated 300 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:13.599976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:13.599976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:13.724102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4765f-81e0-47f5-abc8-319e77db953d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:13.724102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4765f-81e0-47f5-abc8-319e77db953d service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.724102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4765f-81e0-47f5-abc8-319e77db953d service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.724102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4765f-81e0-47f5-abc8-319e77db953d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.725100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9bf4765f-81e0-47f5-abc8-319e77db953d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:13.727209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73224531-f202-45ac-9270-6d61020f90eb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:13.728754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4765f-81e0-47f5-abc8-319e77db953d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:13.730592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4765f-81e0-47f5-abc8-319e77db953d service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:13.741984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:13.743443 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.751433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.753011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] PATH_INFO: `/v3/users/bbaa724be8dc418eb2e331e944976edf` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.757255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbaa724be8dc418eb2e331e944976edf)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:13.760515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 882/1792] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:13.760925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:13.762147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e9f4-eb22-497f-976b-268bf8bc773e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.762442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e9f4-eb22-497f-976b-268bf8bc773e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.762840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36e9f4-eb22-497f-976b-268bf8bc773e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.764229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 883/1793] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:13.765213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36e9f4-eb22-497f-976b-268bf8bc773e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:13.767903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6b36e9f4-eb22-497f-976b-268bf8bc773e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:13.812515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36e9f4-eb22-497f-976b-268bf8bc773e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:13.832220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec05e8-c071-485a-8a85-3316bd18c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:13.833089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec05e8-c071-485a-8a85-3316bd18c7ef admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.833750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec05e8-c071-485a-8a85-3316bd18c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.841595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec05e8-c071-485a-8a85-3316bd18c7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.842502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec05e8-c071-485a-8a85-3316bd18c7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:13.846020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec05e8-c071-485a-8a85-3316bd18c7ef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:13.865181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 884/1794] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:13.866817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f3ba-147b-42a0-9ef2-ef540b989636 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.867301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f3ba-147b-42a0-9ef2-ef540b989636 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.868195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f3ba-147b-42a0-9ef2-ef540b989636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.889487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4c32f3ba-147b-42a0-9ef2-ef540b989636 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:13.891052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4c32f3ba-147b-42a0-9ef2-ef540b989636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:13.906243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 885/1795] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:01:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:13.907175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32f3ba-147b-42a0-9ef2-ef540b989636 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:13.921900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32f3ba-147b-42a0-9ef2-ef540b989636 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:13.934427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:13.936091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:13.936596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:13.937081 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] PATH_INFO: `/v3/projects/5fbb805f54e6438888412e6ced1a2058/users/aa38c9af6dbb4e21b9618f37c4a81870/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:13.997521 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbb805f54e6438888412e6ced1a2058, user_id=aa38c9af6dbb4e21b9618f37c4a81870, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:14.002579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:14.101330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbaa724be8dc418eb2e331e944976edf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.104356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbaa724be8dc418eb2e331e944976edf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.105273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbaa724be8dc418eb2e331e944976edf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.118513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 886/1796] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:13 2022] PUT /identity/v3/projects/5fbb805f54e6438888412e6ced1a2058/users/aa38c9af6dbb4e21b9618f37c4a81870/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:14.120246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:14.122034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:14.280665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbaa724be8dc418eb2e331e944976edf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.306790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbaa724be8dc418eb2e331e944976edf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.319674 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53edb-a9d9-40ef-9c18-021acfea8a34 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:14.337987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:14.339552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:14.340860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:14.341443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:14.341556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 911/1797] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:13 2022] DELETE /identity/v3/users/bbaa724be8dc418eb2e331e944976edf => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:14.343069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:14.345368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:14.346593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:14.384116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:14.393758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:14.419502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 887/1798] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:14.420414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:14.422216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:14.467588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0085f9-e822-48ce-86ff-a8fad238582c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:14.476182 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:14.477457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:14.477935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:14.499054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] PATH_INFO: `/v3/projects/ff561063a668484d9ec310e6ea8deb1b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:14.500996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff561063a668484d9ec310e6ea8deb1b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:14.503240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:14.588589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522a48a-1dd4-43f6-aaa9-f8caabfe9663 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:14.595937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0ca8-96b5-4c07-9d3b-80d6589984b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:14.597773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0ca8-96b5-4c07-9d3b-80d6589984b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:14.599430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0ca8-96b5-4c07-9d3b-80d6589984b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:14.599801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0ca8-96b5-4c07-9d3b-80d6589984b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:14.600954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f0ca8-96b5-4c07-9d3b-80d6589984b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:14.602848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f0ca8-96b5-4c07-9d3b-80d6589984b6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:14.647515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 888/1799] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:14.657220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0ca8-96b5-4c07-9d3b-80d6589984b6 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:14.684828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0ca8-96b5-4c07-9d3b-80d6589984b6 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:14.703968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff561063a668484d9ec310e6ea8deb1b', 'request_id': 'req-57c8b247-5d88-4684-8d66-f63b3d5fbd79'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.744949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff561063a668484d9ec310e6ea8deb1b', 'request_id': 'req-57c8b247-5d88-4684-8d66-f63b3d5fbd79'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.768382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff561063a668484d9ec310e6ea8deb1b', 'request_id': 'req-57c8b247-5d88-4684-8d66-f63b3d5fbd79'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.796610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:14.857239 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] The token cache is being invalidate because project ff561063a668484d9ec310e6ea8deb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:14.857936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.858829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:14.865505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926451a-b5c2-4e6c-93c0-9100b3ffb83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:14.867291 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926451a-b5c2-4e6c-93c0-9100b3ffb83c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:14.868037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926451a-b5c2-4e6c-93c0-9100b3ffb83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:14.868527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926451a-b5c2-4e6c-93c0-9100b3ffb83c admin admin] PATH_INFO: `/v3/projects/5fbb805f54e6438888412e6ced1a2058/users/aa38c9af6dbb4e21b9618f37c4a81870/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:14.873247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 912/1800] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:14 2022] DELETE /identity/v3/projects/ff561063a668484d9ec310e6ea8deb1b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:14.873247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:14.876333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:14.877135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926451a-b5c2-4e6c-93c0-9100b3ffb83c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbb805f54e6438888412e6ced1a2058, user_id=aa38c9af6dbb4e21b9618f37c4a81870, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:14.880904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926451a-b5c2-4e6c-93c0-9100b3ffb83c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:14.898166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 889/1801] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:14 2022] PUT /identity/v3/projects/5fbb805f54e6438888412e6ced1a2058/users/aa38c9af6dbb4e21b9618f37c4a81870/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:14.901103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf5cd-d7d4-480e-b8fb-4a9837356f7e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:14.901706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf5cd-d7d4-480e-b8fb-4a9837356f7e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:14.902277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf5cd-d7d4-480e-b8fb-4a9837356f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:14.904980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8b247-5d88-4684-8d66-f63b3d5fbd79 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:14.936539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1fcbf5cd-d7d4-480e-b8fb-4a9837356f7e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:14.938589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1fcbf5cd-d7d4-480e-b8fb-4a9837356f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:15.018335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:15.021748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:15.022184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:15.022530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] PATH_INFO: `/v3/projects/3526cbf184754645b033b7fd54f791bd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:15.025880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3526cbf184754645b033b7fd54f791bd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:15.031013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:15.205701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 890/1802] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:15.216974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd78da-3ab2-47b5-bfd0-a816237bfd85 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:15.216974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd78da-3ab2-47b5-bfd0-a816237bfd85 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:15.216974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd78da-3ab2-47b5-bfd0-a816237bfd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:15.236799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3526cbf184754645b033b7fd54f791bd', 'request_id': 'req-2aaad0d1-c29d-4f10-a373-c2785c65aec1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:15.262310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3526cbf184754645b033b7fd54f791bd', 'request_id': 'req-2aaad0d1-c29d-4f10-a373-c2785c65aec1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:15.281929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3526cbf184754645b033b7fd54f791bd', 'request_id': 'req-2aaad0d1-c29d-4f10-a373-c2785c65aec1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:15.318136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a2cd78da-3ab2-47b5-bfd0-a816237bfd85 None None] MFA Rules not processed for user `aa38c9af6dbb4e21b9618f37c4a81870`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:15.366711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a2cd78da-3ab2-47b5-bfd0-a816237bfd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:15.568048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 891/1803] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:15.571085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870b6a-e92c-4152-b394-c069037083a5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:15.571784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870b6a-e92c-4152-b394-c069037083a5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:15.572678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30870b6a-e92c-4152-b394-c069037083a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:15.637043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-30870b6a-e92c-4152-b394-c069037083a5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:15.638545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-30870b6a-e92c-4152-b394-c069037083a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:15.828822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 892/1804] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:15.831480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30870b6a-e92c-4152-b394-c069037083a5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:15.839609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-30870b6a-e92c-4152-b394-c069037083a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:15.957280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30870b6a-e92c-4152-b394-c069037083a5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:15.967575 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3dacd-71ca-4a6e-93f4-029e2ef28686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:15.968267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3dacd-71ca-4a6e-93f4-029e2ef28686 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:15.968556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3dacd-71ca-4a6e-93f4-029e2ef28686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:15.968839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3dacd-71ca-4a6e-93f4-029e2ef28686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:15.994527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3dacd-71ca-4a6e-93f4-029e2ef28686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:15.997008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3dacd-71ca-4a6e-93f4-029e2ef28686 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:16.048151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 893/1805] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:16.049242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3dacd-71ca-4a6e-93f4-029e2ef28686 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:16.083639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3dacd-71ca-4a6e-93f4-029e2ef28686 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:16.101463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:16.102770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:16.103066 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:16.103356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:16.104791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:16.105117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:16.112437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:16.140664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 894/1806] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:16.142020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:16.149836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:16.209607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5f0dc-9f06-4a34-9700-c3ee40368d6a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:16.235460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:16.236422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:16.236833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:16.237125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] PATH_INFO: `/v3/users/2182e2a1f2ca436eac5357680d97a106` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:16.238561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2182e2a1f2ca436eac5357680d97a106)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:16.242031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:16.243272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] The token cache is being invalidate because project 3526cbf184754645b033b7fd54f791bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:16.243901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:16.246818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:16.254212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 913/1807] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:14 2022] DELETE /identity/v3/projects/3526cbf184754645b033b7fd54f791bd => generated 0 bytes in 1384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:16.257333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:16.261863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:16.325046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaad0d1-c29d-4f10-a373-c2785c65aec1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:16.342552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd964d13-a5a3-4068-aa77-17253768c653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:16.343769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964d13-a5a3-4068-aa77-17253768c653 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:16.344424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964d13-a5a3-4068-aa77-17253768c653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:16.345285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd964d13-a5a3-4068-aa77-17253768c653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:16.346376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd964d13-a5a3-4068-aa77-17253768c653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:16.351630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd964d13-a5a3-4068-aa77-17253768c653 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:16.398977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:16.534216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 914/1808] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:16 2022] POST /identity/v3/projects => generated 391 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:16.538613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fc74-2339-4b09-ace0-3d9f3d874d8d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:16.539439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fc74-2339-4b09-ace0-3d9f3d874d8d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:16.543697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fc74-2339-4b09-ace0-3d9f3d874d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:16.586352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fba5fc74-2339-4b09-ace0-3d9f3d874d8d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:16.588638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fba5fc74-2339-4b09-ace0-3d9f3d874d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:16.651995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2182e2a1f2ca436eac5357680d97a106'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:16.660970 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2182e2a1f2ca436eac5357680d97a106'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:16.672220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2182e2a1f2ca436eac5357680d97a106'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:16.673559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2182e2a1f2ca436eac5357680d97a106'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:16.729605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 915/1809] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:16.731493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5fc74-2339-4b09-ace0-3d9f3d874d8d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:16.733268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fba5fc74-2339-4b09-ace0-3d9f3d874d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:16.758623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5fc74-2339-4b09-ace0-3d9f3d874d8d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:16.771436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:16.773285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:16.773733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:16.774511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] PATH_INFO: `/v3/projects/1f4a5c2909cf4973b9d3f641d7fe0e2c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:16.776243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4a5c2909cf4973b9d3f641d7fe0e2c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:16.778608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.000656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2182e2a1f2ca436eac5357680d97a106'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:17.080913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4a5c2909cf4973b9d3f641d7fe0e2c', 'request_id': 'req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:17.081643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 895/1810] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:16 2022] DELETE /identity/v3/users/2182e2a1f2ca436eac5357680d97a106 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:17.088488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.107339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:17.123186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4a5c2909cf4973b9d3f641d7fe0e2c', 'request_id': 'req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:17.137448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4a5c2909cf4973b9d3f641d7fe0e2c', 'request_id': 'req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:17.258534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] The token cache is being invalidate because project 1f4a5c2909cf4973b9d3f641d7fe0e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:17.259313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:17.260503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f4ca773e-cbbf-4e2b-abe5-f360e6db6c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:17.263873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 916/1811] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:16 2022] DELETE /identity/v3/projects/1f4a5c2909cf4973b9d3f641d7fe0e2c => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:17.265298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc88e47-80f5-4665-966e-3272e40cdc3a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.268193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f838c-ca50-4aba-8065-e436b574b1e6 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.269208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc88e47-80f5-4665-966e-3272e40cdc3a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.273567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc88e47-80f5-4665-966e-3272e40cdc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.285672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec740-45ca-4c83-9668-c8aa83fca9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.289017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec740-45ca-4c83-9668-c8aa83fca9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.289401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec740-45ca-4c83-9668-c8aa83fca9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.289868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec740-45ca-4c83-9668-c8aa83fca9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.293079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ec740-45ca-4c83-9668-c8aa83fca9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:17.299174 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ec740-45ca-4c83-9668-c8aa83fca9e6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.318423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-abc88e47-80f5-4665-966e-3272e40cdc3a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:17.325061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-abc88e47-80f5-4665-966e-3272e40cdc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:17.349959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 917/1812] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:17.353233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa1e2-1583-4612-acd4-fcb33a18ce32 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.353233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa1e2-1583-4612-acd4-fcb33a18ce32 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.353233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa1e2-1583-4612-acd4-fcb33a18ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.411383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5a0aa1e2-1583-4612-acd4-fcb33a18ce32 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:17.413077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5a0aa1e2-1583-4612-acd4-fcb33a18ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:17.430404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 896/1813] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:17 2022] POST /identity/v3/users => generated 296 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:17.439256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630eaab-a3f1-449f-b2f7-632c739c2bd6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.439256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630eaab-a3f1-449f-b2f7-632c739c2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.439256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630eaab-a3f1-449f-b2f7-632c739c2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.439712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 918/1814] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:17.440275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aa1e2-1583-4612-acd4-fcb33a18ce32 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.454283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aa1e2-1583-4612-acd4-fcb33a18ce32 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.473749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6630eaab-a3f1-449f-b2f7-632c739c2bd6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:17.473749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6630eaab-a3f1-449f-b2f7-632c739c2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:17.475537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.477103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.477650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.478350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.479825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:17.480208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:17.483400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.506549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 897/1815] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:17.506549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630eaab-a3f1-449f-b2f7-632c739c2bd6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.508396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 919/1816] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:17.508396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.508718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6630eaab-a3f1-449f-b2f7-632c739c2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:17.510871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:17.530613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630eaab-a3f1-449f-b2f7-632c739c2bd6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.540596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ed094-78d0-4f73-a835-7237f7bbb88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.541310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ed094-78d0-4f73-a835-7237f7bbb88d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.541596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ed094-78d0-4f73-a835-7237f7bbb88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.541879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ed094-78d0-4f73-a835-7237f7bbb88d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.542927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ed094-78d0-4f73-a835-7237f7bbb88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:17.544573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ed094-78d0-4f73-a835-7237f7bbb88d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.589459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 898/1817] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:17.591410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43b8f-695e-4b3c-9d9a-636196a2f1fd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.591874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43b8f-695e-4b3c-9d9a-636196a2f1fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.593283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed43b8f-695e-4b3c-9d9a-636196a2f1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.625544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2ed43b8f-695e-4b3c-9d9a-636196a2f1fd None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:17.627094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2ed43b8f-695e-4b3c-9d9a-636196a2f1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:17.641681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 899/1818] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:17.642717 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43b8f-695e-4b3c-9d9a-636196a2f1fd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.654000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec01aca-db7a-484e-83c9-b9920d56a921 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.656840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed43b8f-695e-4b3c-9d9a-636196a2f1fd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.660638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd90c1-b379-407c-94d1-a2078ec6ccf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.664424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13eeb0-75ac-4ce5-95f6-60d6af459844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.665657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13eeb0-75ac-4ce5-95f6-60d6af459844 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.666029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13eeb0-75ac-4ce5-95f6-60d6af459844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.666339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13eeb0-75ac-4ce5-95f6-60d6af459844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.667545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13eeb0-75ac-4ce5-95f6-60d6af459844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:17.669920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13eeb0-75ac-4ce5-95f6-60d6af459844 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.670536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd90c1-b379-407c-94d1-a2078ec6ccf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.673746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd90c1-b379-407c-94d1-a2078ec6ccf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.673746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd90c1-b379-407c-94d1-a2078ec6ccf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.699221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd90c1-b379-407c-94d1-a2078ec6ccf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:17.700371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd90c1-b379-407c-94d1-a2078ec6ccf4 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.722591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 920/1819] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:17.724391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd90c1-b379-407c-94d1-a2078ec6ccf4 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.742257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd90c1-b379-407c-94d1-a2078ec6ccf4 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.750466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a494c1-799b-4e2e-9975-62e98cc48432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.752377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a494c1-799b-4e2e-9975-62e98cc48432 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.752616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a494c1-799b-4e2e-9975-62e98cc48432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.753199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a494c1-799b-4e2e-9975-62e98cc48432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.754955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a494c1-799b-4e2e-9975-62e98cc48432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:17.756918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a494c1-799b-4e2e-9975-62e98cc48432 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.784751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 921/1820] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:17.786869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a494c1-799b-4e2e-9975-62e98cc48432 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.813171 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a494c1-799b-4e2e-9975-62e98cc48432 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.813368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 900/1821] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:17 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:17.814867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13eeb0-75ac-4ce5-95f6-60d6af459844 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:17.966948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13eeb0-75ac-4ce5-95f6-60d6af459844 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:17.970220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.971124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.971571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.972015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:17.972953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:17.974773 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:17.978763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:17.984836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af13e92-d37b-48dc-a199-6c24c05ef8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:17.987461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af13e92-d37b-48dc-a199-6c24c05ef8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:17.990416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af13e92-d37b-48dc-a199-6c24c05ef8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:17.990416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af13e92-d37b-48dc-a199-6c24c05ef8f4 admin admin] PATH_INFO: `/v3/projects/93381f9cf76540c2b5b7ed338af4239e/users/34a6a6dcf3384f0dbbab8c9f8afd5e3b/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:18.018681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 922/1822] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:18.019937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:18.024354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af13e92-d37b-48dc-a199-6c24c05ef8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93381f9cf76540c2b5b7ed338af4239e, user_id=34a6a6dcf3384f0dbbab8c9f8afd5e3b, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:18.030112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af13e92-d37b-48dc-a199-6c24c05ef8f4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:18.062123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e04d1-293d-4c1b-82e5-418e01ad7313 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:18.073070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34021da-6436-4360-9c0d-15c3871818a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:18.074343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34021da-6436-4360-9c0d-15c3871818a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:18.074730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34021da-6436-4360-9c0d-15c3871818a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:18.075161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34021da-6436-4360-9c0d-15c3871818a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:18.076918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34021da-6436-4360-9c0d-15c3871818a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:18.080544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34021da-6436-4360-9c0d-15c3871818a9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:18.186093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 901/1823] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:17 2022] PUT /identity/v3/projects/93381f9cf76540c2b5b7ed338af4239e/users/34a6a6dcf3384f0dbbab8c9f8afd5e3b/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:18.187830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af13e92-d37b-48dc-a199-6c24c05ef8f4 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:18.213099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:18.223798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 923/1824] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:18 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:18.231444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b1786-836b-4d48-ae5c-4b355930a1a5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:18.231839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b1786-836b-4d48-ae5c-4b355930a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:18.233260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b1786-836b-4d48-ae5c-4b355930a1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:18.300595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-693b1786-836b-4d48-ae5c-4b355930a1a5 None None] MFA Rules not processed for user `34a6a6dcf3384f0dbbab8c9f8afd5e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:18.305241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-693b1786-836b-4d48-ae5c-4b355930a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:18.336326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af13e92-d37b-48dc-a199-6c24c05ef8f4 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:18.345879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f179d-e825-4fc1-8d74-c192a57f8cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:18.346606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f179d-e825-4fc1-8d74-c192a57f8cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:18.347078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f179d-e825-4fc1-8d74-c192a57f8cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:18.347439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f179d-e825-4fc1-8d74-c192a57f8cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:18.348164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f179d-e825-4fc1-8d74-c192a57f8cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:18.354449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f179d-e825-4fc1-8d74-c192a57f8cb1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:18.448822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 924/1825] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:18.457401 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b1786-836b-4d48-ae5c-4b355930a1a5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:18.483852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b1786-836b-4d48-ae5c-4b355930a1a5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:18.491123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10d63a-8394-432d-87fd-f9177d2758c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:18.491992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d63a-8394-432d-87fd-f9177d2758c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:18.492336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d63a-8394-432d-87fd-f9177d2758c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:18.492683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10d63a-8394-432d-87fd-f9177d2758c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:18.493499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10d63a-8394-432d-87fd-f9177d2758c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:18.523793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 902/1826] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:18 2022] POST /identity/v3/projects => generated 363 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:18.525898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f179d-e825-4fc1-8d74-c192a57f8cb1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:18.542626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10d63a-8394-432d-87fd-f9177d2758c7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:18.573263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 925/1827] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:18.574340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10d63a-8394-432d-87fd-f9177d2758c7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:18.608643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10d63a-8394-432d-87fd-f9177d2758c7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:18.621529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:18.626211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:18.626211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:18.626211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:18.626509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:18.631256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:18.638554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f179d-e825-4fc1-8d74-c192a57f8cb1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:18.647639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b580dc-f8a4-408a-b5b0-4496caa1bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:18.648332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b580dc-f8a4-408a-b5b0-4496caa1bf3f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:18.649678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b580dc-f8a4-408a-b5b0-4496caa1bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:18.649678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b580dc-f8a4-408a-b5b0-4496caa1bf3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:18.651432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b580dc-f8a4-408a-b5b0-4496caa1bf3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:18.654529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b580dc-f8a4-408a-b5b0-4496caa1bf3f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:18.806162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 903/1828] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:18 2022] POST /identity/v3/projects => generated 393 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:18.812398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b580dc-f8a4-408a-b5b0-4496caa1bf3f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:18.847305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 926/1829] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:18 2022] POST /identity/v3/users => generated 282 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:18.852353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:18.858561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:18.887001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:18.902514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc703f1-1485-4478-ac3c-3afc4ade15ec admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:18.949966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b580dc-f8a4-408a-b5b0-4496caa1bf3f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:18.964447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3bbe-510a-49c0-bb15-849abdb3166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:18.966113 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3bbe-510a-49c0-bb15-849abdb3166d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:18.966405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3bbe-510a-49c0-bb15-849abdb3166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:18.966986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3bbe-510a-49c0-bb15-849abdb3166d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:18.968155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3bbe-510a-49c0-bb15-849abdb3166d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:18.970282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3bbe-510a-49c0-bb15-849abdb3166d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:18.986179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 904/1830] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:18.987448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3bbe-510a-49c0-bb15-849abdb3166d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:19.002488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:19.013259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3bbe-510a-49c0-bb15-849abdb3166d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:19.055371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5faf04-d6c1-4757-b3bb-684bdb11a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:19.055371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5faf04-d6c1-4757-b3bb-684bdb11a0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:19.055371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5faf04-d6c1-4757-b3bb-684bdb11a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:19.055371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5faf04-d6c1-4757-b3bb-684bdb11a0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:19.057209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5faf04-d6c1-4757-b3bb-684bdb11a0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:19.057209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5faf04-d6c1-4757-b3bb-684bdb11a0d5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:19.068293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:19.069142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:19.071634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:19.071926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] PATH_INFO: `/v3/projects/452186ff420949fe8f4a46556ada5ae4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:19.079587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=452186ff420949fe8f4a46556ada5ae4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:19.084010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:19.154994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 905/1831] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:18 2022] POST /identity/v3/users => generated 303 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:19.155960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5faf04-d6c1-4757-b3bb-684bdb11a0d5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:19.181024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5faf04-d6c1-4757-b3bb-684bdb11a0d5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:19.189136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a08f3-4c1e-49c4-97fd-5a2e7cc26246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:19.190220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a08f3-4c1e-49c4-97fd-5a2e7cc26246 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:19.190715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a08f3-4c1e-49c4-97fd-5a2e7cc26246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:19.191201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a08f3-4c1e-49c4-97fd-5a2e7cc26246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:19.192842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a08f3-4c1e-49c4-97fd-5a2e7cc26246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:19.194906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a08f3-4c1e-49c4-97fd-5a2e7cc26246 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:19.213842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 906/1832] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:19.213842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a08f3-4c1e-49c4-97fd-5a2e7cc26246 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:19.225019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a08f3-4c1e-49c4-97fd-5a2e7cc26246 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:19.231075 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0104548-8deb-4e68-a9d7-2fa71c8402e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:19.232473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0104548-8deb-4e68-a9d7-2fa71c8402e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:19.232816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0104548-8deb-4e68-a9d7-2fa71c8402e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:19.233258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0104548-8deb-4e68-a9d7-2fa71c8402e9 admin admin] PATH_INFO: `/v3/projects/99d13fb97c344c68866c90f5e1597b7b/users/2a4c31ae614e4220ba84a8553a7d9e83/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:19.261705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0104548-8deb-4e68-a9d7-2fa71c8402e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d13fb97c344c68866c90f5e1597b7b, user_id=2a4c31ae614e4220ba84a8553a7d9e83, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:19.264401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0104548-8deb-4e68-a9d7-2fa71c8402e9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:19.456286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 907/1833] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:19 2022] PUT /identity/v3/projects/99d13fb97c344c68866c90f5e1597b7b/users/2a4c31ae614e4220ba84a8553a7d9e83/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:19.457248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0104548-8deb-4e68-a9d7-2fa71c8402e9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:19.475305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452186ff420949fe8f4a46556ada5ae4', 'request_id': 'req-4f8e47a8-8197-4094-82fe-72524db65200'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:19.491621 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452186ff420949fe8f4a46556ada5ae4', 'request_id': 'req-4f8e47a8-8197-4094-82fe-72524db65200'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:19.507506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452186ff420949fe8f4a46556ada5ae4', 'request_id': 'req-4f8e47a8-8197-4094-82fe-72524db65200'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:19.559702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0104548-8deb-4e68-a9d7-2fa71c8402e9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:19.668962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:19.669488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:19.669870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:19.670309 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:19.671119 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:19.690163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:19.700265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 908/1834] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:19.701885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] The token cache is being invalidate because project 452186ff420949fe8f4a46556ada5ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:19.710922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:19.710922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4f8e47a8-8197-4094-82fe-72524db65200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:19.710922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 927/1835] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:18 2022] DELETE /identity/v3/projects/452186ff420949fe8f4a46556ada5ae4 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:19.710922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ccc3-d563-4692-8c72-21435baecbbd None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:19.710922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ccc3-d563-4692-8c72-21435baecbbd None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:19.710922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7ccc3-d563-4692-8c72-21435baecbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:19.714977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:19.719441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:19.751335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257d9a9-ad50-4c0c-a824-f4cebe6ca7ba admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:19.769041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:19.770296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:19.770758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:19.771212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:19.772368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:19.781513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:19.788190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-66d7ccc3-d563-4692-8c72-21435baecbbd None None] MFA Rules not processed for user `2a4c31ae614e4220ba84a8553a7d9e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:19.789986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-66d7ccc3-d563-4692-8c72-21435baecbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:19.811610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 909/1836] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:19.812603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:19.816387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:19.840503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd8b2b-b2fc-4f4c-aca3-20d47daec14c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:19.852899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d59c94-c643-4ee0-b9d5-8f700fcb7bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:19.867869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59c94-c643-4ee0-b9d5-8f700fcb7bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:19.869656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59c94-c643-4ee0-b9d5-8f700fcb7bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:19.871903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59c94-c643-4ee0-b9d5-8f700fcb7bfc admin admin] PATH_INFO: `/v3/projects/6542b119489945ccb2ab385b1a111665/users/832f6896435a401681d7c6a74613803b/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:19.929040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d59c94-c643-4ee0-b9d5-8f700fcb7bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6542b119489945ccb2ab385b1a111665, user_id=832f6896435a401681d7c6a74613803b, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:19.936845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d59c94-c643-4ee0-b9d5-8f700fcb7bfc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:20.017209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 928/1837] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:20.017209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7ccc3-d563-4692-8c72-21435baecbbd None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:20.019167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-66d7ccc3-d563-4692-8c72-21435baecbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:20.060166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7ccc3-d563-4692-8c72-21435baecbbd None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:20.075532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:20.076823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:20.077251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:20.077724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] PATH_INFO: `/v3/users/aa38c9af6dbb4e21b9618f37c4a81870` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:20.080957 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa38c9af6dbb4e21b9618f37c4a81870)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:20.085567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:20.154773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 910/1838] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:19 2022] PUT /identity/v3/projects/6542b119489945ccb2ab385b1a111665/users/832f6896435a401681d7c6a74613803b/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:20.181259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d59c94-c643-4ee0-b9d5-8f700fcb7bfc admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:20.329519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d59c94-c643-4ee0-b9d5-8f700fcb7bfc admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:20.336284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:20.338379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:20.338930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:20.339457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] PATH_INFO: `/v3/projects/f3a7856c544f4a18a962db3e4bfb140f/users/3427e14e35124a88a105f8fde00c648a/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:20.377918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a7856c544f4a18a962db3e4bfb140f, user_id=3427e14e35124a88a105f8fde00c648a, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:20.383374 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:20.515482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 911/1839] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:20 2022] PUT /identity/v3/projects/f3a7856c544f4a18a962db3e4bfb140f/users/3427e14e35124a88a105f8fde00c648a/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:20.516391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:20.518016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:20.610192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa38c9af6dbb4e21b9618f37c4a81870'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:20.611504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa38c9af6dbb4e21b9618f37c4a81870'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:20.612280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa38c9af6dbb4e21b9618f37c4a81870'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:20.618479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1aa1dd-113a-4e0c-b143-da1d136a4103 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:20.624501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab7109-1ec6-418c-b9bd-5de155e0d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:20.625527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7109-1ec6-418c-b9bd-5de155e0d524 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:20.626046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7109-1ec6-418c-b9bd-5de155e0d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:20.626365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7109-1ec6-418c-b9bd-5de155e0d524 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:20.627312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab7109-1ec6-418c-b9bd-5de155e0d524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:20.629369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab7109-1ec6-418c-b9bd-5de155e0d524 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:20.644858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:20.658403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa38c9af6dbb4e21b9618f37c4a81870'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:20.674980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa38c9af6dbb4e21b9618f37c4a81870'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:20.703497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 929/1840] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:20 2022] DELETE /identity/v3/users/aa38c9af6dbb4e21b9618f37c4a81870 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:20.703497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:20.703680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:20.730001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 912/1841] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:20 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:20.730001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabc897-1395-49ab-bb2c-0760e1851252 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:20.730001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabc897-1395-49ab-bb2c-0760e1851252 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:20.730001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabc897-1395-49ab-bb2c-0760e1851252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:20.805709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3dabc897-1395-49ab-bb2c-0760e1851252 None None] MFA Rules not processed for user `3427e14e35124a88a105f8fde00c648a`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:20.807168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3dabc897-1395-49ab-bb2c-0760e1851252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:20.823658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:20.845470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9a352-7b45-48e7-b6f2-5da2f5cee226 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:20.887165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 913/1842] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:20.888313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabc897-1395-49ab-bb2c-0760e1851252 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:20.889672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3dabc897-1395-49ab-bb2c-0760e1851252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:20.920312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:20.921176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:20.921877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:20.921877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:20.922724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:20.925005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:20.937463 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 930/1843] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:20.938160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:20.941746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:20.956371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46911a54-865f-462b-bef2-18eaeef5a76b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:20.962126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:20.967316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:20.967316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:20.967316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:20.967316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:20.967316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:20.967757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabc897-1395-49ab-bb2c-0760e1851252 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:20.972689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:20.973811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:20.974642 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:20.974642 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] PATH_INFO: `/v3/users/7f5fdb1ab82a4195b9057dc27c14b187` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:20.975755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5fdb1ab82a4195b9057dc27c14b187)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:20.977706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.061854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 931/1844] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:20 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:21.061854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.061854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:21.074595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe8f7-4e74-4a45-bd6b-04375a627499 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.079673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d7e7-7837-42c1-9cf5-5c8410bc335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.080347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d7e7-7837-42c1-9cf5-5c8410bc335c admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.080627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d7e7-7837-42c1-9cf5-5c8410bc335c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.080906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2d7e7-7837-42c1-9cf5-5c8410bc335c admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.081612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2d7e7-7837-42c1-9cf5-5c8410bc335c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.083855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea2d7e7-7837-42c1-9cf5-5c8410bc335c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.220027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 932/1845] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:21 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:21.222669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d7e7-7837-42c1-9cf5-5c8410bc335c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.228622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5fdb1ab82a4195b9057dc27c14b187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:21.229312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5fdb1ab82a4195b9057dc27c14b187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:21.237261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5fdb1ab82a4195b9057dc27c14b187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:21.237988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5fdb1ab82a4195b9057dc27c14b187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:21.299830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=79,keystone:INSERT=5,keystone:DELETE=16 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:21.304079 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2d7e7-7837-42c1-9cf5-5c8410bc335c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.309148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.310075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.310438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.310713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] PATH_INFO: `/v3/projects/6542b119489945ccb2ab385b1a111665/users/832f6896435a401681d7c6a74613803b/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.312792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6542b119489945ccb2ab385b1a111665, user_id=832f6896435a401681d7c6a74613803b, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.315377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.325926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5fdb1ab82a4195b9057dc27c14b187'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:21.327823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 933/1846] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:21 2022] PUT /identity/v3/projects/6542b119489945ccb2ab385b1a111665/users/832f6896435a401681d7c6a74613803b/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:21.330612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.335423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:21.346276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 914/1847] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:20 2022] DELETE /identity/v3/users/7f5fdb1ab82a4195b9057dc27c14b187 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:21.347155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.348512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:21.408924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b2855-281c-44b7-81a5-30cdec4d65a1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.431758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da794c-b29b-4374-85f8-9455f7831e2f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.438751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b89456-bd85-4a38-a615-5c7cc78d78ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.440018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89456-bd85-4a38-a615-5c7cc78d78ad admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.440151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89456-bd85-4a38-a615-5c7cc78d78ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.440450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b89456-bd85-4a38-a615-5c7cc78d78ad admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.441624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b89456-bd85-4a38-a615-5c7cc78d78ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.444681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b89456-bd85-4a38-a615-5c7cc78d78ad admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.496426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387db4e-dd21-443b-b8f9-4ff11abf906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.497186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387db4e-dd21-443b-b8f9-4ff11abf906a admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.497527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387db4e-dd21-443b-b8f9-4ff11abf906a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.497814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387db4e-dd21-443b-b8f9-4ff11abf906a admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.498588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387db4e-dd21-443b-b8f9-4ff11abf906a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.500240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387db4e-dd21-443b-b8f9-4ff11abf906a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.511771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 934/1848] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:21.514156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aed270-bc71-495d-8ca6-b04b6dc57da6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.514156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aed270-bc71-495d-8ca6-b04b6dc57da6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.514156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aed270-bc71-495d-8ca6-b04b6dc57da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.542946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-71aed270-bc71-495d-8ca6-b04b6dc57da6 None None] MFA Rules not processed for user `832f6896435a401681d7c6a74613803b`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:21.547131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-71aed270-bc71-495d-8ca6-b04b6dc57da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:21.584730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 915/1849] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:21 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:21.585854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c997f4-f54f-4a93-8e23-26751c825349 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.586919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c997f4-f54f-4a93-8e23-26751c825349 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.587661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c997f4-f54f-4a93-8e23-26751c825349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.616139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c5c997f4-f54f-4a93-8e23-26751c825349 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:21.620393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c5c997f4-f54f-4a93-8e23-26751c825349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:21.632021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 916/1850] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:21.633238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c997f4-f54f-4a93-8e23-26751c825349 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.650787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c997f4-f54f-4a93-8e23-26751c825349 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.657969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.663089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 935/1851] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:21.663574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.663574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.663730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aed270-bc71-495d-8ca6-b04b6dc57da6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.663811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] PATH_INFO: `/v3/projects/5f38a894b6654c4c807587933befa61e/users/e75fb3fc61814747acb85d7055591931/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.679396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aed270-bc71-495d-8ca6-b04b6dc57da6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.694475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f38a894b6654c4c807587933befa61e, user_id=e75fb3fc61814747acb85d7055591931, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.694475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.694795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.694795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.694795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.694795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.695470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.695470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.707832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 936/1852] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:21.708842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.710614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:21.770796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5c3e-6dc2-46b9-91f3-8f11277576c2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.774843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485eb51-5ecf-4ecd-a3c1-d93189005b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.775512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485eb51-5ecf-4ecd-a3c1-d93189005b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.775807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485eb51-5ecf-4ecd-a3c1-d93189005b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.776227 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485eb51-5ecf-4ecd-a3c1-d93189005b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.784872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 917/1853] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:21 2022] PUT /identity/v3/projects/5f38a894b6654c4c807587933befa61e/users/e75fb3fc61814747acb85d7055591931/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:21.787563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.788307 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485eb51-5ecf-4ecd-a3c1-d93189005b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.789844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485eb51-5ecf-4ecd-a3c1-d93189005b46 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.790275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:21.800870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 937/1854] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:21.802549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485eb51-5ecf-4ecd-a3c1-d93189005b46 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.813592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485eb51-5ecf-4ecd-a3c1-d93189005b46 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.875150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf55ee5-df4c-4ab8-a96f-2ca1ab7dd76b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.880638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.883125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.883125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.883125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.886024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98c029-276c-4f01-af2c-1d3151997381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.887070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98c029-276c-4f01-af2c-1d3151997381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.887360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98c029-276c-4f01-af2c-1d3151997381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.887729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98c029-276c-4f01-af2c-1d3151997381 admin admin] PATH_INFO: `/v3/projects/5355618edc47445fabb95f3adb9c3364/users/4854a95ff9cd49aa94cfbedd90ab94df/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.905140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98c029-276c-4f01-af2c-1d3151997381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5355618edc47445fabb95f3adb9c3364, user_id=4854a95ff9cd49aa94cfbedd90ab94df, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.907740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98c029-276c-4f01-af2c-1d3151997381 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.948770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.952045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:21.960170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 918/1855] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:21.960965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:21.962399 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:21.979242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3e426-9727-4875-bfda-9f41331bd808 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:21.987824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:21.988320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:21.988806 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:21.989780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] PATH_INFO: `/v3/projects/5fbb805f54e6438888412e6ced1a2058` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:21.991825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbb805f54e6438888412e6ced1a2058)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:21.995362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.018693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 938/1856] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:21 2022] PUT /identity/v3/projects/5355618edc47445fabb95f3adb9c3364/users/4854a95ff9cd49aa94cfbedd90ab94df/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:22.023798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98c029-276c-4f01-af2c-1d3151997381 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.116645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98c029-276c-4f01-af2c-1d3151997381 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.127292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ecc49-627a-4e8a-92df-75c6e8f8bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.129354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ecc49-627a-4e8a-92df-75c6e8f8bb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.130433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ecc49-627a-4e8a-92df-75c6e8f8bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.132346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ecc49-627a-4e8a-92df-75c6e8f8bb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.134129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ecc49-627a-4e8a-92df-75c6e8f8bb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.136828 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ecc49-627a-4e8a-92df-75c6e8f8bb2f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.138603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbb805f54e6438888412e6ced1a2058', 'request_id': 'req-31bd556c-dc16-4e58-816b-c6fa7ec761d7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.149743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbb805f54e6438888412e6ced1a2058', 'request_id': 'req-31bd556c-dc16-4e58-816b-c6fa7ec761d7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.158279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 939/1857] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:22.160466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ecc49-627a-4e8a-92df-75c6e8f8bb2f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.187679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ecc49-627a-4e8a-92df-75c6e8f8bb2f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.228541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbb805f54e6438888412e6ced1a2058', 'request_id': 'req-31bd556c-dc16-4e58-816b-c6fa7ec761d7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.243394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] The token cache is being invalidate because project 5fbb805f54e6438888412e6ced1a2058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:22.244529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.244896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.247215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 919/1858] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:21 2022] DELETE /identity/v3/projects/5fbb805f54e6438888412e6ced1a2058 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:22.252166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.253610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.267798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.268507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.272533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.272533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.272533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.272533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.283240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 940/1859] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:22.284362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.288250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.303489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b50510-5c6f-470c-bc78-f77c56abd9b5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.309197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffabbf-fd5e-4096-b153-bf824723a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.310396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffabbf-fd5e-4096-b153-bf824723a98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.310396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffabbf-fd5e-4096-b153-bf824723a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.310695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffabbf-fd5e-4096-b153-bf824723a98e admin admin] PATH_INFO: `/v3/projects/5f38a894b6654c4c807587933befa61e/users/e75fb3fc61814747acb85d7055591931/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.314190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffabbf-fd5e-4096-b153-bf824723a98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f38a894b6654c4c807587933befa61e, user_id=e75fb3fc61814747acb85d7055591931, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.317842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffabbf-fd5e-4096-b153-bf824723a98e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.346400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd556c-dc16-4e58-816b-c6fa7ec761d7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.358617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 941/1860] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:22 2022] PUT /identity/v3/projects/5f38a894b6654c4c807587933befa61e/users/e75fb3fc61814747acb85d7055591931/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:22.358912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd936c1-6265-4d28-a216-5e431d969a82 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.359358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd936c1-6265-4d28-a216-5e431d969a82 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.360041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd936c1-6265-4d28-a216-5e431d969a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.379906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:22.386722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9dd936c1-6265-4d28-a216-5e431d969a82 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:22.388586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9dd936c1-6265-4d28-a216-5e431d969a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.443696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302df21-c906-46f0-b531-47b401337aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.444577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302df21-c906-46f0-b531-47b401337aac service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.444948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302df21-c906-46f0-b531-47b401337aac service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.445330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302df21-c906-46f0-b531-47b401337aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.448159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2302df21-c906-46f0-b531-47b401337aac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.472911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 942/1861] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:22.480884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd936c1-6265-4d28-a216-5e431d969a82 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.480884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9dd936c1-6265-4d28-a216-5e431d969a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.491319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd936c1-6265-4d28-a216-5e431d969a82 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.497760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.501790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.501790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.501790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] PATH_INFO: `/v3/projects/5355618edc47445fabb95f3adb9c3364/users/4854a95ff9cd49aa94cfbedd90ab94df/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.501790 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5355618edc47445fabb95f3adb9c3364, user_id=4854a95ff9cd49aa94cfbedd90ab94df, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.506419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.521397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 943/1862] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:22 2022] PUT /identity/v3/projects/5355618edc47445fabb95f3adb9c3364/users/4854a95ff9cd49aa94cfbedd90ab94df/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:22.531148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.531148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.539314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302df21-c906-46f0-b531-47b401337aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.540785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302df21-c906-46f0-b531-47b401337aac service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.554693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 920/1863] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:22.556131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b1e99-1a09-430a-a3cd-ba5c900f8eea None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.556429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b1e99-1a09-430a-a3cd-ba5c900f8eea None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.556709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b1e99-1a09-430a-a3cd-ba5c900f8eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.587163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-270b1e99-1a09-430a-a3cd-ba5c900f8eea None None] MFA Rules not processed for user `e75fb3fc61814747acb85d7055591931`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:22.588394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-270b1e99-1a09-430a-a3cd-ba5c900f8eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.627835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25e739-32e8-4895-aee2-919b8ed9b0cc admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.634686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.634686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.634686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.634686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] PATH_INFO: `/v3/projects/0fb52ca6a1ef487d96aebe100f8a8b39` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.635539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb52ca6a1ef487d96aebe100f8a8b39)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.638261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.682295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 921/1864] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:22.687766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510fff4-3ebd-4ffb-b71a-607c647df95b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.688240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510fff4-3ebd-4ffb-b71a-607c647df95b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.688647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510fff4-3ebd-4ffb-b71a-607c647df95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.709574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6510fff4-3ebd-4ffb-b71a-607c647df95b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:22.711009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6510fff4-3ebd-4ffb-b71a-607c647df95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.720850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 922/1865] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:22.724215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e986bd-faf0-41c9-8984-295bcd1857e8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.724509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e986bd-faf0-41c9-8984-295bcd1857e8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.724787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e986bd-faf0-41c9-8984-295bcd1857e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.754617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-57e986bd-faf0-41c9-8984-295bcd1857e8 None None] MFA Rules not processed for user `4854a95ff9cd49aa94cfbedd90ab94df`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:22.756117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-57e986bd-faf0-41c9-8984-295bcd1857e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.771867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb52ca6a1ef487d96aebe100f8a8b39', 'request_id': 'req-bd6513b9-85d6-4606-8f6f-130f7e990202'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.779478 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb52ca6a1ef487d96aebe100f8a8b39', 'request_id': 'req-bd6513b9-85d6-4606-8f6f-130f7e990202'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.786129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb52ca6a1ef487d96aebe100f8a8b39', 'request_id': 'req-bd6513b9-85d6-4606-8f6f-130f7e990202'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.840572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 923/1866] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:22.841888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e986bd-faf0-41c9-8984-295bcd1857e8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.843329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-57e986bd-faf0-41c9-8984-295bcd1857e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.850393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] The token cache is being invalidate because project 0fb52ca6a1ef487d96aebe100f8a8b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:22.850822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.851932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:22.853515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 944/1867] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:22 2022] DELETE /identity/v3/projects/0fb52ca6a1ef487d96aebe100f8a8b39 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:22.857466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.861326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.910875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e986bd-faf0-41c9-8984-295bcd1857e8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.914825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.915480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.915770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.916053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.918027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.939782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6513b9-85d6-4606-8f6f-130f7e990202 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.949520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.950640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.951125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.951696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.952999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:22.953438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.955330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.968663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 945/1868] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:22.969812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:22.973971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:22.987304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29de3e7-c049-4774-9a22-6efbd5b513ae admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:22.987682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.989634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:22.992837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:22.993727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:22.994014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:22.994325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] PATH_INFO: `/v3/users/6510a015be0949d68a24e9f006b89f5b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:22.995570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6510a015be0949d68a24e9f006b89f5b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:22.997491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:23.000557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 924/1869] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:23.005122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:23.012577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0bc04-44b4-46ca-a5cb-1ea3e01d819e service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:23.018383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:23.019222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:23.019613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:23.020488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:23.021798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:23.024739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:23.112794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 925/1870] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:23 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:23.112794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:23.112794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:23.171536 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375154cb-b18f-4247-b47c-90a4d24a38b2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:23.175240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:23.175920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:23.176271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:23.176610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:23.178538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:23.204000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6510a015be0949d68a24e9f006b89f5b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:23.205674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6510a015be0949d68a24e9f006b89f5b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:23.206305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6510a015be0949d68a24e9f006b89f5b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:23.246977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:23.248448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:23.268650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 926/1871] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:23.269632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:23.280046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6510a015be0949d68a24e9f006b89f5b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:23.299564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6510a015be0949d68a24e9f006b89f5b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:23.320813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 946/1872] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:22 2022] DELETE /identity/v3/users/6510a015be0949d68a24e9f006b89f5b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:23.354136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d1f82-4d41-4243-abfa-3e5910ad4314 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:23.422844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44aed3-4df8-46ea-b4d0-6a472d14cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:23.423708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44aed3-4df8-46ea-b4d0-6a472d14cc29 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:23.424102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44aed3-4df8-46ea-b4d0-6a472d14cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:23.424523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44aed3-4df8-46ea-b4d0-6a472d14cc29 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:23.425388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44aed3-4df8-46ea-b4d0-6a472d14cc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:23.427981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44aed3-4df8-46ea-b4d0-6a472d14cc29 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:23.633015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 927/1873] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:23 2022] POST /identity/v3/users => generated 291 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:23.633108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:23.635565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:23.653948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f0f7-603f-4f08-a134-fa347232523c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:23.660967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44597dcc-a929-4f1d-b2c9-5e538140b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:23.661903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597dcc-a929-4f1d-b2c9-5e538140b894 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:23.662387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597dcc-a929-4f1d-b2c9-5e538140b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:23.662743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597dcc-a929-4f1d-b2c9-5e538140b894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:23.663656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44597dcc-a929-4f1d-b2c9-5e538140b894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:23.665489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44597dcc-a929-4f1d-b2c9-5e538140b894 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:23.713047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 947/1874] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:23.716875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44aed3-4df8-46ea-b4d0-6a472d14cc29 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:23.727988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44aed3-4df8-46ea-b4d0-6a472d14cc29 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:23.733273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5581d9-5d7f-49ca-a9fa-c27b840c8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:23.734227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5581d9-5d7f-49ca-a9fa-c27b840c8aad admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:23.734896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5581d9-5d7f-49ca-a9fa-c27b840c8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:23.735329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5581d9-5d7f-49ca-a9fa-c27b840c8aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:23.736217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5581d9-5d7f-49ca-a9fa-c27b840c8aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:23.737971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5581d9-5d7f-49ca-a9fa-c27b840c8aad admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:23.751565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 928/1875] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:23.756722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44597dcc-a929-4f1d-b2c9-5e538140b894 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:23.770565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44597dcc-a929-4f1d-b2c9-5e538140b894 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:23.800562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30d8ee-31d4-44fb-9af2-4fc0b159bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:23.803115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30d8ee-31d4-44fb-9af2-4fc0b159bc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:23.804691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30d8ee-31d4-44fb-9af2-4fc0b159bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:23.806922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30d8ee-31d4-44fb-9af2-4fc0b159bc87 admin admin] PATH_INFO: `/v3/projects/df4b7483497d42b6b97616355c73804b/users/5578847801064188bfd1b8a29c7c595d/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:23.836406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30d8ee-31d4-44fb-9af2-4fc0b159bc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4b7483497d42b6b97616355c73804b, user_id=5578847801064188bfd1b8a29c7c595d, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:23.839812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30d8ee-31d4-44fb-9af2-4fc0b159bc87 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:24.028133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 948/1876] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:23 2022] PUT /identity/v3/projects/df4b7483497d42b6b97616355c73804b/users/5578847801064188bfd1b8a29c7c595d/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:24.032193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637762f8-39ce-4d8d-a083-8aed0018830d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:24.033038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637762f8-39ce-4d8d-a083-8aed0018830d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:24.033610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637762f8-39ce-4d8d-a083-8aed0018830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:24.054573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:24.094548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-637762f8-39ce-4d8d-a083-8aed0018830d None None] MFA Rules not processed for user `5578847801064188bfd1b8a29c7c595d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:24.095822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-637762f8-39ce-4d8d-a083-8aed0018830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:24.206959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 929/1877] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:24.220291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30d8ee-31d4-44fb-9af2-4fc0b159bc87 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:24.272141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637762f8-39ce-4d8d-a083-8aed0018830d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:24.273851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-637762f8-39ce-4d8d-a083-8aed0018830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:24.315797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30d8ee-31d4-44fb-9af2-4fc0b159bc87 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:24.335078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936091f7-7000-450e-b6c0-aa890bac5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:24.335078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936091f7-7000-450e-b6c0-aa890bac5659 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:24.335078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936091f7-7000-450e-b6c0-aa890bac5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:24.335078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936091f7-7000-450e-b6c0-aa890bac5659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:24.336538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936091f7-7000-450e-b6c0-aa890bac5659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:24.336538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936091f7-7000-450e-b6c0-aa890bac5659 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:24.390852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637762f8-39ce-4d8d-a083-8aed0018830d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:24.395702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:24.396574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:24.396856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:24.397135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] PATH_INFO: `/v3/projects/f0e3326c5b2243d0b8ae343f4f4d8b75` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:24.399395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e3326c5b2243d0b8ae343f4f4d8b75)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:24.402860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:24.440695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 949/1878] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:24 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:24.445578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936091f7-7000-450e-b6c0-aa890bac5659 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:24.553764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936091f7-7000-450e-b6c0-aa890bac5659 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:24.560349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b948d1-5f67-4fc7-bcfd-46fd4be92ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:24.563686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b948d1-5f67-4fc7-bcfd-46fd4be92ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:24.563686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b948d1-5f67-4fc7-bcfd-46fd4be92ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:24.563686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b948d1-5f67-4fc7-bcfd-46fd4be92ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:24.563686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b948d1-5f67-4fc7-bcfd-46fd4be92ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:24.565609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b948d1-5f67-4fc7-bcfd-46fd4be92ef1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:24.793820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e3326c5b2243d0b8ae343f4f4d8b75', 'request_id': 'req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:24.806379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e3326c5b2243d0b8ae343f4f4d8b75', 'request_id': 'req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:24.855731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 950/1879] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:24 2022] POST /identity/v3/users => generated 296 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:24.857354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b948d1-5f67-4fc7-bcfd-46fd4be92ef1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:24.868492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b948d1-5f67-4fc7-bcfd-46fd4be92ef1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:24.965445 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1badc2-b915-49f1-9d2f-9ff7b11fd627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:24.965986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1badc2-b915-49f1-9d2f-9ff7b11fd627 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:24.966348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1badc2-b915-49f1-9d2f-9ff7b11fd627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:24.966658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1badc2-b915-49f1-9d2f-9ff7b11fd627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:24.967459 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1badc2-b915-49f1-9d2f-9ff7b11fd627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:24.969224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1badc2-b915-49f1-9d2f-9ff7b11fd627 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:24.981421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 951/1880] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:24.987356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1badc2-b915-49f1-9d2f-9ff7b11fd627 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:25.003736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1badc2-b915-49f1-9d2f-9ff7b11fd627 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:25.010928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d6f5-2462-40de-9ec8-0c216c91c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:25.014202 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d6f5-2462-40de-9ec8-0c216c91c087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:25.014587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d6f5-2462-40de-9ec8-0c216c91c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:25.015064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d6f5-2462-40de-9ec8-0c216c91c087 admin admin] PATH_INFO: `/v3/projects/85c2b49a9d86493fbd82534c1a0b4c4a/users/321d22fd5b204bda9e3ad601beacae89/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:25.035674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d6f5-2462-40de-9ec8-0c216c91c087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c2b49a9d86493fbd82534c1a0b4c4a, user_id=321d22fd5b204bda9e3ad601beacae89, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:25.038625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d6f5-2462-40de-9ec8-0c216c91c087 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:25.079866 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e3326c5b2243d0b8ae343f4f4d8b75', 'request_id': 'req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:25.100540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] The token cache is being invalidate because project f0e3326c5b2243d0b8ae343f4f4d8b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:25.100892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:25.106671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ea2ff64d-0ad4-43be-8319-e3efe3ca11c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:25.108837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 930/1881] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:24 2022] DELETE /identity/v3/projects/f0e3326c5b2243d0b8ae343f4f4d8b75 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:25.114783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9622b-3c59-4204-bbf4-60568b127e99 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:25.115280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9622b-3c59-4204-bbf4-60568b127e99 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:25.115556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9622b-3c59-4204-bbf4-60568b127e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:25.149935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-aae9622b-3c59-4204-bbf4-60568b127e99 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:25.151783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-aae9622b-3c59-4204-bbf4-60568b127e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:25.187833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 931/1882] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:25.193451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9622b-3c59-4204-bbf4-60568b127e99 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:25.199047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-aae9622b-3c59-4204-bbf4-60568b127e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:25.230052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9622b-3c59-4204-bbf4-60568b127e99 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:25.240606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:25.242492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:25.243127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:25.243748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] PATH_INFO: `/v3/users/3427e14e35124a88a105f8fde00c648a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:25.246360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3427e14e35124a88a105f8fde00c648a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:25.250339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:25.343725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 952/1883] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:24 2022] PUT /identity/v3/projects/85c2b49a9d86493fbd82534c1a0b4c4a/users/321d22fd5b204bda9e3ad601beacae89/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:25.346039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa7696-6442-4a15-be86-e0d9c8c15078 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:25.346537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa7696-6442-4a15-be86-e0d9c8c15078 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:25.347240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa7696-6442-4a15-be86-e0d9c8c15078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:25.372048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-39fa7696-6442-4a15-be86-e0d9c8c15078 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:25.373408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-39fa7696-6442-4a15-be86-e0d9c8c15078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:25.451000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 953/1884] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:25.451888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa7696-6442-4a15-be86-e0d9c8c15078 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:25.453298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-39fa7696-6442-4a15-be86-e0d9c8c15078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:25.533057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa7696-6442-4a15-be86-e0d9c8c15078 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:25.540183 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75fb3fc61814747acb85d7055591931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f38a894b6654c4c807587933befa61e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:25.540905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:25.541547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:25.541547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:25.542233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:25.542542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:25.544153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:25.563801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 954/1885] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:25.565666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:25.569285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:25.589561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c85d0-fbc2-4a54-8f03-1754beefcf62 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:25.596622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daff334-7f33-40ff-8da8-555a099be645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:25.597332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daff334-7f33-40ff-8da8-555a099be645 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:25.597609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daff334-7f33-40ff-8da8-555a099be645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:25.598513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daff334-7f33-40ff-8da8-555a099be645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:25.599344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daff334-7f33-40ff-8da8-555a099be645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:25.601128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daff334-7f33-40ff-8da8-555a099be645 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:25.617416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 955/1886] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:25.617946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daff334-7f33-40ff-8da8-555a099be645 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:25.635856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daff334-7f33-40ff-8da8-555a099be645 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:25.641350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:25.642338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:25.642624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:25.643116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:25.643872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:25.644185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:25.645951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:25.675464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 956/1887] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:25.675464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:25.689721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272b91a-5ff0-461d-9a28-620ae4a639b6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:25.700764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75fb3fc61814747acb85d7055591931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f38a894b6654c4c807587933befa61e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:25.702091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:25.702720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:25.703323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:25.704837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:25.708932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:25.781577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3427e14e35124a88a105f8fde00c648a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:25.782590 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3427e14e35124a88a105f8fde00c648a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:25.792773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3427e14e35124a88a105f8fde00c648a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:25.794518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3427e14e35124a88a105f8fde00c648a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:25.929928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 957/1888] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:25 2022] POST /identity/v3/projects => generated 353 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:25.931453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:25.935025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:25.985771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3427e14e35124a88a105f8fde00c648a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:26.014475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 932/1889] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:25 2022] DELETE /identity/v3/users/3427e14e35124a88a105f8fde00c648a => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:26.016291 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:26.018785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8020-dc6a-4d64-a440-38f312148e3f tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:26.019145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:26.081294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:26.110016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a7b16-a528-4db1-bfd4-3e09184c1669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:26.112516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7b16-a528-4db1-bfd4-3e09184c1669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.112516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7b16-a528-4db1-bfd4-3e09184c1669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.112516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7b16-a528-4db1-bfd4-3e09184c1669 admin admin] PATH_INFO: `/v3/projects/85c2b49a9d86493fbd82534c1a0b4c4a/users/321d22fd5b204bda9e3ad601beacae89/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.117178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a7b16-a528-4db1-bfd4-3e09184c1669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c2b49a9d86493fbd82534c1a0b4c4a, user_id=321d22fd5b204bda9e3ad601beacae89, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:26.127142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9993b77-1a22-456f-97f5-43d528cd6a5e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:26.127452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a7b16-a528-4db1-bfd4-3e09184c1669 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:26.134774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb112059-1edb-42f1-80fd-e0886eeeb52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:26.137930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112059-1edb-42f1-80fd-e0886eeeb52e admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.137930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112059-1edb-42f1-80fd-e0886eeeb52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.137930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb112059-1edb-42f1-80fd-e0886eeeb52e admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.137930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb112059-1edb-42f1-80fd-e0886eeeb52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:26.139204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb112059-1edb-42f1-80fd-e0886eeeb52e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:26.146220 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 958/1890] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:25 2022] PUT /identity/v3/projects/85c2b49a9d86493fbd82534c1a0b4c4a/users/321d22fd5b204bda9e3ad601beacae89/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:26.148074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048b92-06e3-408e-82b2-1d77a1a1ce6c None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.148467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048b92-06e3-408e-82b2-1d77a1a1ce6c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.148974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9048b92-06e3-408e-82b2-1d77a1a1ce6c None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.151405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 959/1891] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:01:26.156005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9048b92-06e3-408e-82b2-1d77a1a1ce6c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:26.160214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a9048b92-06e3-408e-82b2-1d77a1a1ce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:26.247351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 933/1892] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:26 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:26.249604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3245965-b2ef-4fd7-bced-2bf7eb35a151 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.249995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3245965-b2ef-4fd7-bced-2bf7eb35a151 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.250457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3245965-b2ef-4fd7-bced-2bf7eb35a151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.288157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e3245965-b2ef-4fd7-bced-2bf7eb35a151 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:26.293824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e3245965-b2ef-4fd7-bced-2bf7eb35a151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:26.295940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9048b92-06e3-408e-82b2-1d77a1a1ce6c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:26.396591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 934/1893] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:26.398462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f2710-51a6-4cc1-b837-e1fa08a3cf21 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.399053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f2710-51a6-4cc1-b837-e1fa08a3cf21 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.400144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f2710-51a6-4cc1-b837-e1fa08a3cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.431332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0a9f2710-51a6-4cc1-b837-e1fa08a3cf21 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:26.434810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0a9f2710-51a6-4cc1-b837-e1fa08a3cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:26.444522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13fbc3-c4fb-418d-8a56-d948da26b2c4 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75fb3fc61814747acb85d7055591931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f38a894b6654c4c807587933befa61e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:26.445216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13fbc3-c4fb-418d-8a56-d948da26b2c4 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.445611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13fbc3-c4fb-418d-8a56-d948da26b2c4 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.445915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13fbc3-c4fb-418d-8a56-d948da26b2c4 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.446819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13fbc3-c4fb-418d-8a56-d948da26b2c4 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:26.447030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13fbc3-c4fb-418d-8a56-d948da26b2c4 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:26.450258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13fbc3-c4fb-418d-8a56-d948da26b2c4 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:26.475041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 960/1894] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:26.475041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de79b0-fa0e-4b02-adcc-8602eb10353d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.475041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de79b0-fa0e-4b02-adcc-8602eb10353d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.475041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de79b0-fa0e-4b02-adcc-8602eb10353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.527155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-11de79b0-fa0e-4b02-adcc-8602eb10353d None None] MFA Rules not processed for user `321d22fd5b204bda9e3ad601beacae89`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:26.528711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-11de79b0-fa0e-4b02-adcc-8602eb10353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:26.593286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 935/1895] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:26.602737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f2710-51a6-4cc1-b837-e1fa08a3cf21 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:26.611880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f2710-51a6-4cc1-b837-e1fa08a3cf21 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:26.621269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989180dd-4fab-483a-b312-f3a7a5f7b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:26.621999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989180dd-4fab-483a-b312-f3a7a5f7b110 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.622379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989180dd-4fab-483a-b312-f3a7a5f7b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.622663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989180dd-4fab-483a-b312-f3a7a5f7b110 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.623415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989180dd-4fab-483a-b312-f3a7a5f7b110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:26.625383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989180dd-4fab-483a-b312-f3a7a5f7b110 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:26.750644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 961/1896] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:26.751853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de79b0-fa0e-4b02-adcc-8602eb10353d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:26.753560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-11de79b0-fa0e-4b02-adcc-8602eb10353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:26.817156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 936/1897] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:26 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:26.819073 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989180dd-4fab-483a-b312-f3a7a5f7b110 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:26.864313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989180dd-4fab-483a-b312-f3a7a5f7b110 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:26.871093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e75fb3fc61814747acb85d7055591931', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f38a894b6654c4c807587933befa61e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:26.877842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.878220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.878511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] PATH_INFO: `/v3/projects/7a66317b5363416ead1cc3ea82cea8bd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.880303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7a66317b5363416ead1cc3ea82cea8bd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:26.883169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:26.887427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de79b0-fa0e-4b02-adcc-8602eb10353d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:26.891597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:26.895435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:26.895435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:26.895435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:26.908169 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:26.909718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:26.922331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 962/1898] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:26.923312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:26.924626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:27.021709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:27.037106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ccb9e-3dae-4a8e-b291-a04af7507d01 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:27.048014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a66317b5363416ead1cc3ea82cea8bd', 'request_id': 'req-fa64920b-0924-40ee-9ec3-9b36b0a4c775'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:27.058144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a66317b5363416ead1cc3ea82cea8bd', 'request_id': 'req-fa64920b-0924-40ee-9ec3-9b36b0a4c775'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:27.094684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1399-d225-4fb9-8d11-692072b89bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:27.095652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1399-d225-4fb9-8d11-692072b89bad service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:27.095782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1399-d225-4fb9-8d11-692072b89bad service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:27.096344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1399-d225-4fb9-8d11-692072b89bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:27.137564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a66317b5363416ead1cc3ea82cea8bd', 'request_id': 'req-fa64920b-0924-40ee-9ec3-9b36b0a4c775'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:27.155323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] The token cache is being invalidate because project 7a66317b5363416ead1cc3ea82cea8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:27.155662 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:27.156987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:27.160336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 937/1899] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:26 2022] DELETE /identity/v3/projects/7a66317b5363416ead1cc3ea82cea8bd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:27.161609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:27.165187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:27.202418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1399-d225-4fb9-8d11-692072b89bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:27.208408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1399-d225-4fb9-8d11-692072b89bad service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:27.234852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 963/1900] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:27.237234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1399-d225-4fb9-8d11-692072b89bad service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:27.306349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64920b-0924-40ee-9ec3-9b36b0a4c775 tempest-VolumeQuotaClassesTest-1416923690 tempest-VolumeQuotaClassesTest-1416923690-project-admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:27.313873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:27.314710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:27.314999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:27.315275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:27.318603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:27.355221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:27.357494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:27.359784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1399-d225-4fb9-8d11-692072b89bad service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:27.374052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:27.374777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:27.376524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:27.376524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:27.376524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:27.377732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:27.396255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 964/1901] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:27.403017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 938/1902] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:27.403369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:27.406390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:27.438512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa20ce-65ad-4cff-9589-e1e6cd10301f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:27.452104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:27.452303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:27.452663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:27.456163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:27.457340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:27.460276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:27.471020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 965/1903] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:27.475660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:27.488417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505286c9-c3f2-4aa7-830c-fc725eee8472 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:27.494855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfac0f-8965-41bd-8a84-45486fb24cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:27.496019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfac0f-8965-41bd-8a84-45486fb24cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:27.496425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfac0f-8965-41bd-8a84-45486fb24cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:27.496803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfac0f-8965-41bd-8a84-45486fb24cdc admin admin] PATH_INFO: `/v3/projects/e74b48b07cc64332b99e51b445f6b5a5/users/d11efd00661d43c3a71530c95c16ce9e/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:27.528327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:27.528579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfac0f-8965-41bd-8a84-45486fb24cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74b48b07cc64332b99e51b445f6b5a5, user_id=d11efd00661d43c3a71530c95c16ce9e, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:27.528579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfac0f-8965-41bd-8a84-45486fb24cdc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:27.530877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:27.561989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7a76f-6234-405c-870b-b3e1e8bb2b88 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:27.578955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:27.597395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:27.597395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:27.597395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] PATH_INFO: `/v3/projects/f3a7856c544f4a18a962db3e4bfb140f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:27.597395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a7856c544f4a18a962db3e4bfb140f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:27.597395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:27.782950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 939/1904] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:27 2022] PUT /identity/v3/projects/e74b48b07cc64332b99e51b445f6b5a5/users/d11efd00661d43c3a71530c95c16ce9e/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:27.794503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc66f8-2611-4a9f-b244-9ca9c5f9db10 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:27.794788 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc66f8-2611-4a9f-b244-9ca9c5f9db10 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:27.795128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc66f8-2611-4a9f-b244-9ca9c5f9db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:27.837350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a7856c544f4a18a962db3e4bfb140f', 'request_id': 'req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:27.866806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a7856c544f4a18a962db3e4bfb140f', 'request_id': 'req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:27.872384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-60bc66f8-2611-4a9f-b244-9ca9c5f9db10 None None] MFA Rules not processed for user `d11efd00661d43c3a71530c95c16ce9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:27.873807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-60bc66f8-2611-4a9f-b244-9ca9c5f9db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:27.889235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a7856c544f4a18a962db3e4bfb140f', 'request_id': 'req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:27.998874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 940/1905] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:28.010218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc66f8-2611-4a9f-b244-9ca9c5f9db10 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:28.060205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] The token cache is being invalidate because project f3a7856c544f4a18a962db3e4bfb140f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:28.060997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.061550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.071464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 966/1906] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:27 2022] DELETE /identity/v3/projects/f3a7856c544f4a18a962db3e4bfb140f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:28.072719 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:28.074695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:28.122659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc66f8-2611-4a9f-b244-9ca9c5f9db10 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:28.133285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:28.135334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:28.135867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:28.136360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:28.137984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:28.143543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:28.212484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0354b-7a9c-4d67-ad07-ebc1ed46836d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:28.220626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:28.222278 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:28.223213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:28.223702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] PATH_INFO: `/v3/users/4854a95ff9cd49aa94cfbedd90ab94df` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:28.225795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4854a95ff9cd49aa94cfbedd90ab94df)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:28.229645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:28.303650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 941/1907] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:28 2022] POST /identity/v3/projects => generated 373 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:01:28.304850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:28.308040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:28.432226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db9d2f-8fd7-4b86-8415-15bb59a725d0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:28.438691 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:28.439846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:28.441270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:28.442336 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:28.442683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] PATH_INFO: `/v3/users/5578847801064188bfd1b8a29c7c595d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:28.444191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5578847801064188bfd1b8a29c7c595d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:28.447023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:28.491229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4854a95ff9cd49aa94cfbedd90ab94df'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.492625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4854a95ff9cd49aa94cfbedd90ab94df'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.493412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4854a95ff9cd49aa94cfbedd90ab94df'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.589864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4854a95ff9cd49aa94cfbedd90ab94df'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.604560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4854a95ff9cd49aa94cfbedd90ab94df'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.620491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 967/1908] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:28 2022] DELETE /identity/v3/users/4854a95ff9cd49aa94cfbedd90ab94df => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:28.623042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:28.627752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:28.709998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d313ba-bea0-4f0f-bbd9-86fa9734e48d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:28.719299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:28.720663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:28.721064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:28.721592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:28.722429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:28.727358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:28.808079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5578847801064188bfd1b8a29c7c595d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.809285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5578847801064188bfd1b8a29c7c595d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.820158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5578847801064188bfd1b8a29c7c595d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.821513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5578847801064188bfd1b8a29c7c595d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.831516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 968/1909] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:28 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:28.833046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:28.838252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:28.850605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f244f-b349-4d97-a86e-69dea4801f08 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:28.857142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:28.858802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:28.859552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:28.860039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] PATH_INFO: `/v3/users/2a4c31ae614e4220ba84a8553a7d9e83` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:28.862480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4c31ae614e4220ba84a8553a7d9e83)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:28.867044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:28.925883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5578847801064188bfd1b8a29c7c595d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:28.953509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 942/1910] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:28 2022] DELETE /identity/v3/users/5578847801064188bfd1b8a29c7c595d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:28.954514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:28.958255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:29.044210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df52248-235e-4fb6-9864-4de304904cb9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:29.051165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac00763-4e8b-4d06-8fe8-558f67d4b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:29.052004 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac00763-4e8b-4d06-8fe8-558f67d4b7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:29.052302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac00763-4e8b-4d06-8fe8-558f67d4b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:29.052697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac00763-4e8b-4d06-8fe8-558f67d4b7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:29.053344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac00763-4e8b-4d06-8fe8-558f67d4b7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:29.055025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac00763-4e8b-4d06-8fe8-558f67d4b7ab admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:29.067698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 943/1911] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:29.069123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36208a-205d-44e5-b693-d32742018919 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:29.069418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36208a-205d-44e5-b693-d32742018919 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:29.069696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36208a-205d-44e5-b693-d32742018919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:29.094380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ee36208a-205d-44e5-b693-d32742018919 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:29.095604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ee36208a-205d-44e5-b693-d32742018919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:29.106764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 944/1912] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:29.110886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36208a-205d-44e5-b693-d32742018919 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:29.124527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36208a-205d-44e5-b693-d32742018919 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:29.131430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:29.132332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:29.132618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:29.132924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] PATH_INFO: `/v3/projects/07a9fe2adbe3478fa274139c9d5e776a/users/ab3eb616ec6d45ba8552d5a55b04cf27/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:29.149791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a9fe2adbe3478fa274139c9d5e776a, user_id=ab3eb616ec6d45ba8552d5a55b04cf27, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:29.152481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:29.242860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4c31ae614e4220ba84a8553a7d9e83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:29.243650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4c31ae614e4220ba84a8553a7d9e83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:29.244168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4c31ae614e4220ba84a8553a7d9e83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:29.312770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 945/1913] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:29 2022] PUT /identity/v3/projects/07a9fe2adbe3478fa274139c9d5e776a/users/ab3eb616ec6d45ba8552d5a55b04cf27/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:29.321258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:29.321258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:29.391368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478356aa-876b-4767-af43-97db4622b26a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:29.398381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:29.410928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:29.410928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:29.410928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:29.410928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:29.441167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4c31ae614e4220ba84a8553a7d9e83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:29.472126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4c31ae614e4220ba84a8553a7d9e83'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:29.508591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 969/1914] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:28 2022] DELETE /identity/v3/users/2a4c31ae614e4220ba84a8553a7d9e83 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:29.510436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:29.513365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:29.596616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:29.600650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:29.620059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 946/1915] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:29.622011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:29.629778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:29.649250 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756dd79-fbcd-4d8d-b824-7a0e16139e58 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:29.669981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc4bd0-27c4-4b30-ae73-fc1f16d63a75 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:29.680277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:29.681414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:29.682105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:29.682527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] PATH_INFO: `/v3/projects/5355618edc47445fabb95f3adb9c3364` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:29.684684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5355618edc47445fabb95f3adb9c3364)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:29.686971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:29.779679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ce7e6-9b2d-41ce-a47d-6fa7951e0c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:29.780889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ce7e6-9b2d-41ce-a47d-6fa7951e0c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:29.781264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ce7e6-9b2d-41ce-a47d-6fa7951e0c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:29.781615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ce7e6-9b2d-41ce-a47d-6fa7951e0c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:29.782531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ce7e6-9b2d-41ce-a47d-6fa7951e0c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:29.784372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ce7e6-9b2d-41ce-a47d-6fa7951e0c32 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:29.797145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 947/1916] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:29.798554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fbd89-54ce-49fc-8dec-2d480517cebb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:29.798860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fbd89-54ce-49fc-8dec-2d480517cebb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:29.799167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fbd89-54ce-49fc-8dec-2d480517cebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:29.831609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-291fbd89-54ce-49fc-8dec-2d480517cebb None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:29.833316 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-291fbd89-54ce-49fc-8dec-2d480517cebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:29.843006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 948/1917] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:29.843771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fbd89-54ce-49fc-8dec-2d480517cebb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:29.847973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-291fbd89-54ce-49fc-8dec-2d480517cebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:29.866561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fbd89-54ce-49fc-8dec-2d480517cebb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:29.883927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:29.883927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:29.883927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:29.883927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] PATH_INFO: `/v3/users/34a6a6dcf3384f0dbbab8c9f8afd5e3b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:29.884507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a6a6dcf3384f0dbbab8c9f8afd5e3b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:29.884507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:29.913654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5355618edc47445fabb95f3adb9c3364', 'request_id': 'req-4c9b424b-d722-45e4-8c93-42056b88ef8f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:29.926515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5355618edc47445fabb95f3adb9c3364', 'request_id': 'req-4c9b424b-d722-45e4-8c93-42056b88ef8f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:29.933544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5355618edc47445fabb95f3adb9c3364', 'request_id': 'req-4c9b424b-d722-45e4-8c93-42056b88ef8f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.024810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] The token cache is being invalidate because project 5355618edc47445fabb95f3adb9c3364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:30.025299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.028257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.031651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 970/1918] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:29 2022] DELETE /identity/v3/projects/5355618edc47445fabb95f3adb9c3364 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:30.033350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:30.034810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.148282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b424b-d722-45e4-8c93-42056b88ef8f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:30.157071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:30.158930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.159476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.159833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] PATH_INFO: `/v3/projects/07a9fe2adbe3478fa274139c9d5e776a/users/ab3eb616ec6d45ba8552d5a55b04cf27/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.163620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a9fe2adbe3478fa274139c9d5e776a, user_id=ab3eb616ec6d45ba8552d5a55b04cf27, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:30.169743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:30.202183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a6a6dcf3384f0dbbab8c9f8afd5e3b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.203402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a6a6dcf3384f0dbbab8c9f8afd5e3b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.205259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 971/1919] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:30 2022] PUT /identity/v3/projects/07a9fe2adbe3478fa274139c9d5e776a/users/ab3eb616ec6d45ba8552d5a55b04cf27/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:30.209465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:30.213566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a6a6dcf3384f0dbbab8c9f8afd5e3b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.213802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.215890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a6a6dcf3384f0dbbab8c9f8afd5e3b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.291738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-49750e24-9336-4bc1-aac4-2a4a14467fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a6a6dcf3384f0dbbab8c9f8afd5e3b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.313628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:30.328258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 949/1920] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:29 2022] DELETE /identity/v3/users/34a6a6dcf3384f0dbbab8c9f8afd5e3b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:30.331639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3121dfe-1dec-423e-888e-a65a7f1b60b7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.331639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3121dfe-1dec-423e-888e-a65a7f1b60b7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.331639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3121dfe-1dec-423e-888e-a65a7f1b60b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.345240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4e277-35c7-4b7d-bffb-82fa562d9596 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:30.360188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f3121dfe-1dec-423e-888e-a65a7f1b60b7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:30.361420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f3121dfe-1dec-423e-888e-a65a7f1b60b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.445537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12756002-0530-49fe-91fa-f6dd2c4b669f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:30.446318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756002-0530-49fe-91fa-f6dd2c4b669f service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.446644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756002-0530-49fe-91fa-f6dd2c4b669f service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.446972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12756002-0530-49fe-91fa-f6dd2c4b669f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.449071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-12756002-0530-49fe-91fa-f6dd2c4b669f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.453430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 950/1921] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:30.454851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430a43-1e51-4564-9ef0-b71dc3d4efd6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.455139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430a43-1e51-4564-9ef0-b71dc3d4efd6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.455419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430a43-1e51-4564-9ef0-b71dc3d4efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.463941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12756002-0530-49fe-91fa-f6dd2c4b669f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:30.465382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12756002-0530-49fe-91fa-f6dd2c4b669f service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:30.479446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 972/1922] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:30.480495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48b88f-9b3d-486f-a9ba-752874153719 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.480801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48b88f-9b3d-486f-a9ba-752874153719 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.481086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48b88f-9b3d-486f-a9ba-752874153719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.496102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-86430a43-1e51-4564-9ef0-b71dc3d4efd6 None None] MFA Rules not processed for user `ab3eb616ec6d45ba8552d5a55b04cf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:30.497358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-86430a43-1e51-4564-9ef0-b71dc3d4efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.502237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3d48b88f-9b3d-486f-a9ba-752874153719 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:30.528480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3d48b88f-9b3d-486f-a9ba-752874153719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.528480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 973/1923] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:30.528480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48b88f-9b3d-486f-a9ba-752874153719 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:30.528480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3d48b88f-9b3d-486f-a9ba-752874153719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.534825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48b88f-9b3d-486f-a9ba-752874153719 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:30.540653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:30.553601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.557755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.557755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] PATH_INFO: `/v3/projects/df4b7483497d42b6b97616355c73804b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.558894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4b7483497d42b6b97616355c73804b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:30.560968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:30.649255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 951/1924] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:30.651807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5d31-9cdb-4811-8f4c-0631be91029a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.652317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5d31-9cdb-4811-8f4c-0631be91029a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.652825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5d31-9cdb-4811-8f4c-0631be91029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.700983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-654e5d31-9cdb-4811-8f4c-0631be91029a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:30.706044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-654e5d31-9cdb-4811-8f4c-0631be91029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.730669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 952/1925] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:30.731550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5d31-9cdb-4811-8f4c-0631be91029a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:30.733047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-654e5d31-9cdb-4811-8f4c-0631be91029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.748905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5d31-9cdb-4811-8f4c-0631be91029a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:30.752849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:30.774913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.774913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.774913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.774913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:30.774913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:30.776599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 953/1926] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:30.777407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:30.778865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:30.826317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4b7483497d42b6b97616355c73804b', 'request_id': 'req-d5897115-b8e0-45d3-b959-24e2b3c25962'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.845193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4b7483497d42b6b97616355c73804b', 'request_id': 'req-d5897115-b8e0-45d3-b959-24e2b3c25962'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.858455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4b7483497d42b6b97616355c73804b', 'request_id': 'req-d5897115-b8e0-45d3-b959-24e2b3c25962'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.864505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3df61f-8675-45b9-98d3-02435e39af07 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:30.930682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af27d-5ef0-46a5-9ace-fe69b1a5be7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:30.932323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af27d-5ef0-46a5-9ace-fe69b1a5be7d service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:30.933370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af27d-5ef0-46a5-9ace-fe69b1a5be7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:30.933936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2af27d-5ef0-46a5-9ace-fe69b1a5be7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:30.987668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] The token cache is being invalidate because project df4b7483497d42b6b97616355c73804b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:30.988244 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.989145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:30.992036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 974/1927] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:30 2022] DELETE /identity/v3/projects/df4b7483497d42b6b97616355c73804b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:30.993910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:30.997308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:31.105617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2af27d-5ef0-46a5-9ace-fe69b1a5be7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:31.107372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2af27d-5ef0-46a5-9ace-fe69b1a5be7d service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:31.124439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 954/1928] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:31.125560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af27d-5ef0-46a5-9ace-fe69b1a5be7d service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:31.139669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2af27d-5ef0-46a5-9ace-fe69b1a5be7d service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:31.144217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897115-b8e0-45d3-b959-24e2b3c25962 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:31.145861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:31.147302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:31.147929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:31.149400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] PATH_INFO: `/v3/users/321d22fd5b204bda9e3ad601beacae89` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:31.150296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=321d22fd5b204bda9e3ad601beacae89)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:31.152595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:31.154907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:31.159623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:31.159623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:31.159623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:31.159623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:31.159623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:31.163072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:31.190285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 975/1929] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:31.197507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:31.212815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee2bdc-740d-40b6-a0e1-5f3782a5c437 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:31.239584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:31.246631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:31.246631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:31.246631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:31.246631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:31.246631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:31.396507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 976/1930] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:31 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:01:31.397753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:31.401078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:31.456317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321d22fd5b204bda9e3ad601beacae89'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.458698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321d22fd5b204bda9e3ad601beacae89'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.469464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321d22fd5b204bda9e3ad601beacae89'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.470212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321d22fd5b204bda9e3ad601beacae89'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.495652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6db8ae-fa1f-4099-b94b-48a3a3728b05 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:31.500836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:31.501836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:31.502154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:31.502430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] PATH_INFO: `/v3/projects/99d13fb97c344c68866c90f5e1597b7b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:31.506866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d13fb97c344c68866c90f5e1597b7b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:31.508819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:31.601478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321d22fd5b204bda9e3ad601beacae89'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.625822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 955/1931] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:31 2022] DELETE /identity/v3/users/321d22fd5b204bda9e3ad601beacae89 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:31.626827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:31.639988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:31.667613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d13fb97c344c68866c90f5e1597b7b', 'request_id': 'req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.682503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d13fb97c344c68866c90f5e1597b7b', 'request_id': 'req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.694726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d13fb97c344c68866c90f5e1597b7b', 'request_id': 'req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.720459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:31.770103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97ed4-a52f-486a-83be-bf54543626ab admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:31.788144 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] The token cache is being invalidate because project 99d13fb97c344c68866c90f5e1597b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:31.788626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.789167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:31.791295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 977/1932] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:31 2022] DELETE /identity/v3/projects/99d13fb97c344c68866c90f5e1597b7b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:31.791914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:31.793429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:31.838447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:31.839206 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:31.839496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:31.839782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:31.840502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:31.842814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:31.893672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7efa2-67fb-4f49-b89f-de4887e2ab43 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:31.899708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:31.900595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:31.900883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:31.901162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] PATH_INFO: `/v3/projects/93381f9cf76540c2b5b7ed338af4239e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:31.906859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93381f9cf76540c2b5b7ed338af4239e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:31.906859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:31.987129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 956/1933] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:31 2022] POST /identity/v3/users => generated 294 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:31.987129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:31.987129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:32.004640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee89a-615b-4c88-afe8-9e5f57d02514 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:32.014106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:32.014543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:32.015392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:32.015392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] PATH_INFO: `/v3/users/e75fb3fc61814747acb85d7055591931` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:32.017133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75fb3fc61814747acb85d7055591931)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:32.019234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:32.097472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93381f9cf76540c2b5b7ed338af4239e', 'request_id': 'req-abc76f15-dbd3-43a9-ac9e-65114572513d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.112755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93381f9cf76540c2b5b7ed338af4239e', 'request_id': 'req-abc76f15-dbd3-43a9-ac9e-65114572513d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.122495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93381f9cf76540c2b5b7ed338af4239e', 'request_id': 'req-abc76f15-dbd3-43a9-ac9e-65114572513d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.227710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] The token cache is being invalidate because project 93381f9cf76540c2b5b7ed338af4239e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:32.228181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.234538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.243049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 978/1934] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:31 2022] DELETE /identity/v3/projects/93381f9cf76540c2b5b7ed338af4239e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:32.246146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:32.251931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:32.278809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75fb3fc61814747acb85d7055591931'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.279608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75fb3fc61814747acb85d7055591931'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.292693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75fb3fc61814747acb85d7055591931'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.299943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75fb3fc61814747acb85d7055591931'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.375526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc76f15-dbd3-43a9-ac9e-65114572513d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:32.383355 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:32.384584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:32.385369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:32.385798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:32.387604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:32.394404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:32.395182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75fb3fc61814747acb85d7055591931'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.404723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 979/1935] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:32.406322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:32.408616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:32.433048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdb08-8b29-4237-ad30-d2cafea671da admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:32.448905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 957/1936] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:31 2022] DELETE /identity/v3/users/e75fb3fc61814747acb85d7055591931 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:32.450181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:32.456151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:32.456151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:32.456151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:32.456151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] PATH_INFO: `/v3/projects/85c2b49a9d86493fbd82534c1a0b4c4a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:32.456697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c2b49a9d86493fbd82534c1a0b4c4a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:32.459222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:32.475463 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:32.544697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f945a27-fe10-486a-a697-e83a27da294f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:32.557411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:32.558392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:32.558685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:32.558966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] PATH_INFO: `/v3/users/832f6896435a401681d7c6a74613803b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:32.560291 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] RBAC: Authorizing `identity:delete_user(user_id=832f6896435a401681d7c6a74613803b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:32.562846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:32.654381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c2b49a9d86493fbd82534c1a0b4c4a', 'request_id': 'req-636b4cf5-728c-49f9-8f2e-621a20a70216'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.663101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c2b49a9d86493fbd82534c1a0b4c4a', 'request_id': 'req-636b4cf5-728c-49f9-8f2e-621a20a70216'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.670357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c2b49a9d86493fbd82534c1a0b4c4a', 'request_id': 'req-636b4cf5-728c-49f9-8f2e-621a20a70216'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.809600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] The token cache is being invalidate because project 85c2b49a9d86493fbd82534c1a0b4c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:32.809921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.810685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.815769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 980/1937] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:32 2022] DELETE /identity/v3/projects/85c2b49a9d86493fbd82534c1a0b4c4a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:32.815769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:32.815769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:32.872995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832f6896435a401681d7c6a74613803b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.873725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832f6896435a401681d7c6a74613803b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.883159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832f6896435a401681d7c6a74613803b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.884804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832f6896435a401681d7c6a74613803b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:32.920437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b4cf5-728c-49f9-8f2e-621a20a70216 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:32.925800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:32.926779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:32.927170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:32.927545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:32.928400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:32.930302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:32.945397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 981/1938] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:32.946577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:32.948404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:32.962558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed66fc7-b122-4678-98bf-75c6e34bd38c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:32.967843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:32.973392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:32.973392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:32.973392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] PATH_INFO: `/v3/users/d11efd00661d43c3a71530c95c16ce9e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:32.973392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d11efd00661d43c3a71530c95c16ce9e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:32.973392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:33.039625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-bf148e19-da1e-4f66-a338-98245e03a59e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832f6896435a401681d7c6a74613803b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.058993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 958/1939] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:32 2022] DELETE /identity/v3/users/832f6896435a401681d7c6a74613803b => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:33.060556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7540-739b-4064-a95d-e6654daa5092 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:33.060684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7540-739b-4064-a95d-e6654daa5092 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:33.061096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7540-739b-4064-a95d-e6654daa5092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:33.081035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2efa7540-739b-4064-a95d-e6654daa5092 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:33.082726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2efa7540-739b-4064-a95d-e6654daa5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:33.169504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 959/1940] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:33.169504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7540-739b-4064-a95d-e6654daa5092 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:33.169504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2efa7540-739b-4064-a95d-e6654daa5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:33.170485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:33.182615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7540-739b-4064-a95d-e6654daa5092 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:33.197571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150cd8f-7244-49ed-9c71-ca51072464b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:33.200149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150cd8f-7244-49ed-9c71-ca51072464b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:33.201878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150cd8f-7244-49ed-9c71-ca51072464b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:33.202150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150cd8f-7244-49ed-9c71-ca51072464b1 admin admin] PATH_INFO: `/v3/projects/1766b1eec4df4fef87ca5c6d20eaf9fe/users/c721ef04a2644c419175215f5bece27d/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:33.255225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150cd8f-7244-49ed-9c71-ca51072464b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1766b1eec4df4fef87ca5c6d20eaf9fe, user_id=c721ef04a2644c419175215f5bece27d, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:33.260476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150cd8f-7244-49ed-9c71-ca51072464b1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:33.267331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd11efd00661d43c3a71530c95c16ce9e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.267331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd11efd00661d43c3a71530c95c16ce9e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.267925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd11efd00661d43c3a71530c95c16ce9e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.380675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 960/1941] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:33 2022] PUT /identity/v3/projects/1766b1eec4df4fef87ca5c6d20eaf9fe/users/c721ef04a2644c419175215f5bece27d/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:33.384353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63293419-0782-4cd1-8f71-526e86a4b74e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:33.384648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63293419-0782-4cd1-8f71-526e86a4b74e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:33.384917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63293419-0782-4cd1-8f71-526e86a4b74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:33.409412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-63293419-0782-4cd1-8f71-526e86a4b74e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:33.411356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-63293419-0782-4cd1-8f71-526e86a4b74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:33.417193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd11efd00661d43c3a71530c95c16ce9e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.443232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-aea06721-4857-48b8-a6cd-91c64cea5f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd11efd00661d43c3a71530c95c16ce9e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.467616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 982/1942] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:32 2022] DELETE /identity/v3/users/d11efd00661d43c3a71530c95c16ce9e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:33.469366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ed7df-3120-414d-8ea4-3af00b41180e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:33.469659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ed7df-3120-414d-8ea4-3af00b41180e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:33.470005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ed7df-3120-414d-8ea4-3af00b41180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:33.510550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5f3ed7df-3120-414d-8ea4-3af00b41180e None None] MFA Rules not processed for user `c721ef04a2644c419175215f5bece27d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:33.511902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5f3ed7df-3120-414d-8ea4-3af00b41180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:33.515018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 961/1943] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:33.517155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02476448-a244-4c9e-a9ba-5cfe639f4447 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:33.518203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02476448-a244-4c9e-a9ba-5cfe639f4447 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:33.519150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02476448-a244-4c9e-a9ba-5cfe639f4447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:33.582398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-02476448-a244-4c9e-a9ba-5cfe639f4447 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:33.584500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-02476448-a244-4c9e-a9ba-5cfe639f4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:33.647452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 983/1944] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:33.648722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ed7df-3120-414d-8ea4-3af00b41180e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:33.650403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5f3ed7df-3120-414d-8ea4-3af00b41180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:33.686715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 962/1945] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:33.688191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02476448-a244-4c9e-a9ba-5cfe639f4447 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:33.709463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02476448-a244-4c9e-a9ba-5cfe639f4447 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:33.726584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:33.729650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:33.730169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:33.730672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:33.732050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:33.732668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:33.737182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:33.779448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 963/1946] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:33.784237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:33.784237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:33.787153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ed7df-3120-414d-8ea4-3af00b41180e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:33.793461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:33.794533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:33.794917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:33.795291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] PATH_INFO: `/v3/projects/5f38a894b6654c4c807587933befa61e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:33.796622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f38a894b6654c4c807587933befa61e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:33.799565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:33.810573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d43798-5f4a-4a51-8126-ce861d86f030 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:33.820867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:33.820867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:33.820867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:33.821215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:33.825420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:33.826932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:33.936413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f38a894b6654c4c807587933befa61e', 'request_id': 'req-57c29d31-5c87-40c6-8972-44ff020d327c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.943873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f38a894b6654c4c807587933befa61e', 'request_id': 'req-57c29d31-5c87-40c6-8972-44ff020d327c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.951057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f38a894b6654c4c807587933befa61e', 'request_id': 'req-57c29d31-5c87-40c6-8972-44ff020d327c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:33.964265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 964/1947] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:33 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:33.965350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:33.968117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:34.032713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1f268-b160-4f7b-98b8-6e5186e1a711 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:34.040142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541304f2-c685-46e8-a403-e1f35cff2fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:34.040846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541304f2-c685-46e8-a403-e1f35cff2fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.041285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541304f2-c685-46e8-a403-e1f35cff2fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.041673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541304f2-c685-46e8-a403-e1f35cff2fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.043424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] The token cache is being invalidate because project 5f38a894b6654c4c807587933befa61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:34.043882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:34.045075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:34.048032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 984/1948] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:33 2022] DELETE /identity/v3/projects/5f38a894b6654c4c807587933befa61e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:34.048791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:34.050281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:34.130976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541304f2-c685-46e8-a403-e1f35cff2fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:34.132490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541304f2-c685-46e8-a403-e1f35cff2fd6 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:34.138522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c29d31-5c87-40c6-8972-44ff020d327c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:34.145041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 965/1949] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:34.145570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541304f2-c685-46e8-a403-e1f35cff2fd6 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:34.146435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:34.147482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.147953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.148119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.149009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:34.151208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:34.156243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541304f2-c685-46e8-a403-e1f35cff2fd6 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:34.164364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5d58b-509a-4a5c-b112-a598a24938fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:34.166865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d58b-509a-4a5c-b112-a598a24938fb admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.175186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d58b-509a-4a5c-b112-a598a24938fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.175186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5d58b-509a-4a5c-b112-a598a24938fb admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.175186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5d58b-509a-4a5c-b112-a598a24938fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:34.175186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5d58b-509a-4a5c-b112-a598a24938fb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:34.311217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:34.323350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 985/1950] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:34 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:34.323946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 966/1951] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:34 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:34.324055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:34.324166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea52e3-d04d-4874-bb69-f24270559cbc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.324166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea52e3-d04d-4874-bb69-f24270559cbc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.324166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea52e3-d04d-4874-bb69-f24270559cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.325470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:34.344650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fbea52e3-d04d-4874-bb69-f24270559cbc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:34.345987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fbea52e3-d04d-4874-bb69-f24270559cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:34.420832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e3e00-bc6a-4b70-bf85-7b956603dc7c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:34.431185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:34.433905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.434603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.435128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] PATH_INFO: `/v3/projects/6542b119489945ccb2ab385b1a111665` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.440626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6542b119489945ccb2ab385b1a111665)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:34.443865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:34.517773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 967/1952] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:34.525623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea52e3-d04d-4874-bb69-f24270559cbc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:34.536669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea52e3-d04d-4874-bb69-f24270559cbc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:34.545354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:34.546324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.546757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.547230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.549402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:34.553639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:34.657038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6542b119489945ccb2ab385b1a111665', 'request_id': 'req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:34.668203 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6542b119489945ccb2ab385b1a111665', 'request_id': 'req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:34.677356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6542b119489945ccb2ab385b1a111665', 'request_id': 'req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:34.739974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 968/1953] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:34 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:34.741308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:34.759588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:34.760341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a29b45-7722-426c-95e5-9210a28999ad admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:34.834350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd85173-4a69-4159-8aef-cd1ed85daee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:34.835323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd85173-4a69-4159-8aef-cd1ed85daee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.835756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd85173-4a69-4159-8aef-cd1ed85daee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.836175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd85173-4a69-4159-8aef-cd1ed85daee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.837579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd85173-4a69-4159-8aef-cd1ed85daee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:34.839862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd85173-4a69-4159-8aef-cd1ed85daee3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:34.851602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 969/1954] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:34.852990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02894a9-dfaa-4b8d-a64f-a30f37c2eb90 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.853597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02894a9-dfaa-4b8d-a64f-a30f37c2eb90 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.853597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02894a9-dfaa-4b8d-a64f-a30f37c2eb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.881201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b02894a9-dfaa-4b8d-a64f-a30f37c2eb90 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:34.882465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b02894a9-dfaa-4b8d-a64f-a30f37c2eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:34.886155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] The token cache is being invalidate because project 6542b119489945ccb2ab385b1a111665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:34.886877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:34.888180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:34.894404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 986/1955] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:34 2022] DELETE /identity/v3/projects/6542b119489945ccb2ab385b1a111665 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:34.897519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:34.898456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 970/1956] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:34.900057 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02894a9-dfaa-4b8d-a64f-a30f37c2eb90 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:34.901337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:34.910775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02894a9-dfaa-4b8d-a64f-a30f37c2eb90 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:34.919882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:34.919882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.919882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.920215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] PATH_INFO: `/v3/projects/7da961a023a94421a611d63b13d52c50/users/49a9b7ee68784b85b24647605d3908c2/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.921033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b6706-0821-4fb3-9f42-8d9f340c3ad5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:34.927876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faf79e-f792-4de9-a02c-b65aa284e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:34.928995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf79e-f792-4de9-a02c-b65aa284e7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.929344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf79e-f792-4de9-a02c-b65aa284e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.929784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf79e-f792-4de9-a02c-b65aa284e7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.930652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faf79e-f792-4de9-a02c-b65aa284e7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:34.932446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faf79e-f792-4de9-a02c-b65aa284e7d0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:34.944259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da961a023a94421a611d63b13d52c50, user_id=49a9b7ee68784b85b24647605d3908c2, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:34.949417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 987/1957] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:34.949417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246c9c-3dc8-4039-b0a6-c693e81ea913 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:34.949417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246c9c-3dc8-4039-b0a6-c693e81ea913 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:34.949417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246c9c-3dc8-4039-b0a6-c693e81ea913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:34.954471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.011451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-51246c9c-3dc8-4039-b0a6-c693e81ea913 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:35.011451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-51246c9c-3dc8-4039-b0a6-c693e81ea913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.040965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 988/1958] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:35.041819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51246c9c-3dc8-4039-b0a6-c693e81ea913 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.043348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-51246c9c-3dc8-4039-b0a6-c693e81ea913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.056931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51246c9c-3dc8-4039-b0a6-c693e81ea913 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:35.062543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:35.074396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.074396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.074396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.074396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:35.074396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:35.074396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.092518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 989/1959] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:35.093426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.106375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce034c2-de5c-4b88-bbf6-d8db3e0087ef admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:35.112529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7d913-836b-4d9c-8c0c-6e5154eeb4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:35.113892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d913-836b-4d9c-8c0c-6e5154eeb4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.114306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d913-836b-4d9c-8c0c-6e5154eeb4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.114597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7d913-836b-4d9c-8c0c-6e5154eeb4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.115349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7d913-836b-4d9c-8c0c-6e5154eeb4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:35.116960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7d913-836b-4d9c-8c0c-6e5154eeb4b7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.124324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 971/1960] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:34 2022] PUT /identity/v3/projects/7da961a023a94421a611d63b13d52c50/users/49a9b7ee68784b85b24647605d3908c2/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:35.125438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.127548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.135236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 990/1961] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:35.136735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76ed7-4956-4374-8763-661673b54de0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.137031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76ed7-4956-4374-8763-661673b54de0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.137315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce76ed7-4956-4374-8763-661673b54de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.159034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1ce76ed7-4956-4374-8763-661673b54de0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:35.161325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1ce76ed7-4956-4374-8763-661673b54de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.248783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0bc9e-af93-42cf-beff-5a56fe2422d8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:35.254656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:35.255973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.256321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.256660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] PATH_INFO: `/v3/projects/e74b48b07cc64332b99e51b445f6b5a5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.258035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74b48b07cc64332b99e51b445f6b5a5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:35.259761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 991/1962] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:35.260329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.260709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce76ed7-4956-4374-8763-661673b54de0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.275877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce76ed7-4956-4374-8763-661673b54de0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:35.283224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:35.283911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.284193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.284467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.286342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:35.289915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.443439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74b48b07cc64332b99e51b445f6b5a5', 'request_id': 'req-c5c9995c-38ba-4b68-b452-1770f4bd53be'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:35.454194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74b48b07cc64332b99e51b445f6b5a5', 'request_id': 'req-c5c9995c-38ba-4b68-b452-1770f4bd53be'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:35.563045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 992/1963] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:35 2022] POST /identity/v3/projects => generated 379 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:35.564706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.567622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.578319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74b48b07cc64332b99e51b445f6b5a5', 'request_id': 'req-c5c9995c-38ba-4b68-b452-1770f4bd53be'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:35.598886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] The token cache is being invalidate because project e74b48b07cc64332b99e51b445f6b5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:35.599238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:35.600087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:35.605746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 972/1964] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:35 2022] DELETE /identity/v3/projects/e74b48b07cc64332b99e51b445f6b5a5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:35.607054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.608916 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.661175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764025bb-9166-4cd0-b696-bf0e99aabb51 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:35.670193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:35.670193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.670193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.670193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.670543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:35.671847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.690310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 993/1965] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:35.690310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.692952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.713246 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abeed48-6aad-4fef-8589-c69cfdd4e7b9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:35.718978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:35.719751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.720017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.720226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.720980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:35.721293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:35.724018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.739182 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 994/1966] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:35.740490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.744993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.758374 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9995c-38ba-4b68-b452-1770f4bd53be admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:35.759267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7fc57-89ce-44cd-b4ab-fc2f6deb929d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:35.764280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:35.764942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:35.765549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.765665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:35.765954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.766079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:35.766266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.766569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] PATH_INFO: `/v3/projects/d0a9937e76a440caa5abd1a5ea9ca1c3/users/9046458fa4ce4d0f844f9d35d2d683e7/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:35.767017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:35.769063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.787307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a9937e76a440caa5abd1a5ea9ca1c3, user_id=9046458fa4ce4d0f844f9d35d2d683e7, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:35.791012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:35.881661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:35.940270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 973/1967] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:35 2022] PUT /identity/v3/projects/d0a9937e76a440caa5abd1a5ea9ca1c3/users/9046458fa4ce4d0f844f9d35d2d683e7/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:35.942274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.944145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:35.945868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 995/1968] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:35 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:35.947044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:35.969636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:36.009735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8af41-2d57-46a7-9259-223e1fc33cbb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:36.116382 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b3c60-8f8a-4b5d-9e51-3eb36e4fbb60 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:36.127139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:36.129595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:36.130295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:36.142127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] PATH_INFO: `/v3/users/ab3eb616ec6d45ba8552d5a55b04cf27` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:36.143495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9919f4-a4f0-4263-955f-ad69e85e2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:36.144654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9919f4-a4f0-4263-955f-ad69e85e2f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:36.144945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9919f4-a4f0-4263-955f-ad69e85e2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:36.145224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9919f4-a4f0-4263-955f-ad69e85e2f0b admin admin] PATH_INFO: `/v3/projects/7da961a023a94421a611d63b13d52c50/users/49a9b7ee68784b85b24647605d3908c2/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:36.145496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3eb616ec6d45ba8552d5a55b04cf27)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:36.148593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9919f4-a4f0-4263-955f-ad69e85e2f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da961a023a94421a611d63b13d52c50, user_id=49a9b7ee68784b85b24647605d3908c2, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:36.149891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:36.151906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9919f4-a4f0-4263-955f-ad69e85e2f0b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:36.171786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 996/1969] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:35 2022] PUT /identity/v3/projects/7da961a023a94421a611d63b13d52c50/users/49a9b7ee68784b85b24647605d3908c2/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:36.173860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9919f4-a4f0-4263-955f-ad69e85e2f0b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:36.327502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9919f4-a4f0-4263-955f-ad69e85e2f0b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:36.335485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:36.336697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:36.337119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:36.337743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:36.339087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:36.342769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:36.427264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3eb616ec6d45ba8552d5a55b04cf27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:36.428838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3eb616ec6d45ba8552d5a55b04cf27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:36.445315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3eb616ec6d45ba8552d5a55b04cf27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:36.446572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3eb616ec6d45ba8552d5a55b04cf27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:36.484350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 997/1970] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:36 2022] POST /identity/v3/projects => generated 389 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:36.486097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:36.487894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:36.583399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1740c7-5c8b-464f-9e41-affdd09d6c1b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:36.590165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffa310-06f2-4aae-aa21-78fd64f71d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:36.591453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa310-06f2-4aae-aa21-78fd64f71d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:36.591992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa310-06f2-4aae-aa21-78fd64f71d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:36.592474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffa310-06f2-4aae-aa21-78fd64f71d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:36.593831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffa310-06f2-4aae-aa21-78fd64f71d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:36.596757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffa310-06f2-4aae-aa21-78fd64f71d82 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:36.611380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 998/1971] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:36.612727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea3e9-3c71-421a-bc75-c4ef5130d09d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:36.613561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea3e9-3c71-421a-bc75-c4ef5130d09d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:36.613827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea3e9-3c71-421a-bc75-c4ef5130d09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:36.644775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aefde4e6-0845-4409-a306-e56cd1aa0856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3eb616ec6d45ba8552d5a55b04cf27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:36.646286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4b7ea3e9-3c71-421a-bc75-c4ef5130d09d None None] MFA Rules not processed for user `9046458fa4ce4d0f844f9d35d2d683e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:36.652269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4b7ea3e9-3c71-421a-bc75-c4ef5130d09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:36.671103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 974/1972] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:35 2022] DELETE /identity/v3/users/ab3eb616ec6d45ba8552d5a55b04cf27 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:36.672442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea8add-29f1-4ec2-a75c-64d20feab8e8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:36.672737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea8add-29f1-4ec2-a75c-64d20feab8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:36.673022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea8add-29f1-4ec2-a75c-64d20feab8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:36.705934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d2ea8add-29f1-4ec2-a75c-64d20feab8e8 None None] MFA Rules not processed for user `49a9b7ee68784b85b24647605d3908c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:36.707521 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d2ea8add-29f1-4ec2-a75c-64d20feab8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:36.735259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 999/1973] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:36.740716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea3e9-3c71-421a-bc75-c4ef5130d09d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:36.742336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4b7ea3e9-3c71-421a-bc75-c4ef5130d09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:36.756683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea3e9-3c71-421a-bc75-c4ef5130d09d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:36.808901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 975/1974] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:36.809881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea8add-29f1-4ec2-a75c-64d20feab8e8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:36.825284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173d4d-52c9-41e0-8b02-0639130015b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:36.826785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173d4d-52c9-41e0-8b02-0639130015b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:36.827073 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173d4d-52c9-41e0-8b02-0639130015b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:36.827650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1173d4d-52c9-41e0-8b02-0639130015b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:36.828122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173d4d-52c9-41e0-8b02-0639130015b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:36.830212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1173d4d-52c9-41e0-8b02-0639130015b0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:36.930334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea8add-29f1-4ec2-a75c-64d20feab8e8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:36.937218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:36.938337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:36.938337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:36.942144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:36.942144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:36.942693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:36.961199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 976/1975] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:36.961199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:36.961199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:36.974752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1000/1976] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:36 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:36.976883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173d4d-52c9-41e0-8b02-0639130015b0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:36.995170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1173d4d-52c9-41e0-8b02-0639130015b0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.002959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daac7ef-7829-4f14-b490-001edb4d1277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.004947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daac7ef-7829-4f14-b490-001edb4d1277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.005286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daac7ef-7829-4f14-b490-001edb4d1277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.005637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daac7ef-7829-4f14-b490-001edb4d1277 admin admin] PATH_INFO: `/v3/projects/17e6dd1c5d754835bc279e65d6c5a7ed/users/ba3e7b7d81094e93bd88d6b23861f126/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.014977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:37.038275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daac7ef-7829-4f14-b490-001edb4d1277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e6dd1c5d754835bc279e65d6c5a7ed, user_id=ba3e7b7d81094e93bd88d6b23861f126, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.043141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daac7ef-7829-4f14-b490-001edb4d1277 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.056215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74234b4-31fa-4b71-a3d1-ae671c15f89b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.063050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dd3d7-71a7-427e-9071-8e503865d57f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.063747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd3d7-71a7-427e-9071-8e503865d57f service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.064136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd3d7-71a7-427e-9071-8e503865d57f service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.064514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dd3d7-71a7-427e-9071-8e503865d57f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.170118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1001/1977] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:36 2022] PUT /identity/v3/projects/17e6dd1c5d754835bc279e65d6c5a7ed/users/ba3e7b7d81094e93bd88d6b23861f126/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:37.170118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daac7ef-7829-4f14-b490-001edb4d1277 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:37.180191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dd3d7-71a7-427e-9071-8e503865d57f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.182309 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dd3d7-71a7-427e-9071-8e503865d57f service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.199874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 977/1978] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:37.202213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f7fd-1b3f-41c9-9228-5f9209f19976 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.202619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f7fd-1b3f-41c9-9228-5f9209f19976 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.203099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f7fd-1b3f-41c9-9228-5f9209f19976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.253199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-55b2f7fd-1b3f-41c9-9228-5f9209f19976 None None] MFA Rules not processed for user `ba3e7b7d81094e93bd88d6b23861f126`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:37.254937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-55b2f7fd-1b3f-41c9-9228-5f9209f19976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:37.317909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daac7ef-7829-4f14-b490-001edb4d1277 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.327177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e612e-13f3-4ab7-89b3-e855a366dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.328419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e612e-13f3-4ab7-89b3-e855a366dba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.328781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e612e-13f3-4ab7-89b3-e855a366dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.329355 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e612e-13f3-4ab7-89b3-e855a366dba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.330725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e612e-13f3-4ab7-89b3-e855a366dba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.334745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e612e-13f3-4ab7-89b3-e855a366dba7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.354714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1002/1979] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:37.356173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e612e-13f3-4ab7-89b3-e855a366dba7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:37.368370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e612e-13f3-4ab7-89b3-e855a366dba7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.381065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd2ff1-012e-4845-bd3f-e98efa8fc3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.381830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd2ff1-012e-4845-bd3f-e98efa8fc3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.382092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd2ff1-012e-4845-bd3f-e98efa8fc3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.382353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd2ff1-012e-4845-bd3f-e98efa8fc3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.383092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd2ff1-012e-4845-bd3f-e98efa8fc3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.386456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd2ff1-012e-4845-bd3f-e98efa8fc3a5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.390378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 978/1980] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:37.391426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f7fd-1b3f-41c9-9228-5f9209f19976 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:37.405474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f7fd-1b3f-41c9-9228-5f9209f19976 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.410462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1003/1981] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:01:37.414793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd2ff1-012e-4845-bd3f-e98efa8fc3a5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:37.418126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.418820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.419237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.419465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.420489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.422472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.431826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:37.445952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd2ff1-012e-4845-bd3f-e98efa8fc3a5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.459348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.459595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.460201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.460201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] PATH_INFO: `/v3/projects/f10b89c75ff24bd98694370587720885/users/58cda7941c4a4453a5a4ae9921e5585c/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.479042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10b89c75ff24bd98694370587720885, user_id=58cda7941c4a4453a5a4ae9921e5585c, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.481918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.578138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1004/1982] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:37 2022] PUT /identity/v3/projects/f10b89c75ff24bd98694370587720885/users/58cda7941c4a4453a5a4ae9921e5585c/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:37.578953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:37.582935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:37.590243 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 979/1983] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:37 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:37.591374 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:37.594982 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:37.707309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72659-a886-4917-b65f-7acbddbc609b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.715144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e963b-28e2-4180-87fa-1fca3c59a003 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.720856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.721776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.722077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.723025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] PATH_INFO: `/v3/projects/07a9fe2adbe3478fa274139c9d5e776a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.724313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a9fe2adbe3478fa274139c9d5e776a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.727289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.771818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea803a-db80-4813-a22c-448718ca4f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:37.772672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea803a-db80-4813-a22c-448718ca4f7b service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:37.773055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea803a-db80-4813-a22c-448718ca4f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:37.773829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea803a-db80-4813-a22c-448718ca4f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:37.877120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea803a-db80-4813-a22c-448718ca4f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:37.879611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea803a-db80-4813-a22c-448718ca4f7b service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:37.893359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1005/1984] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:37.896984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea803a-db80-4813-a22c-448718ca4f7b service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:37.933983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea803a-db80-4813-a22c-448718ca4f7b service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:37.951190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a9fe2adbe3478fa274139c9d5e776a', 'request_id': 'req-af4bce50-88de-4761-be8f-0ce299695afe'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:37.962968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a9fe2adbe3478fa274139c9d5e776a', 'request_id': 'req-af4bce50-88de-4761-be8f-0ce299695afe'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.043881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:38.046792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.047123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.047920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.048329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:38.052124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:38.119778 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a9fe2adbe3478fa274139c9d5e776a', 'request_id': 'req-af4bce50-88de-4761-be8f-0ce299695afe'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.141496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] The token cache is being invalidate because project 07a9fe2adbe3478fa274139c9d5e776a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:38.141807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.142534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-af4bce50-88de-4761-be8f-0ce299695afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.144390 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 980/1985] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:37 2022] DELETE /identity/v3/projects/07a9fe2adbe3478fa274139c9d5e776a => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:38.145571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a12fe-5f9f-482b-bfb1-5bb5277bc4b1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.145864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a12fe-5f9f-482b-bfb1-5bb5277bc4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.146193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a12fe-5f9f-482b-bfb1-5bb5277bc4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.163418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1006/1986] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:37 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:38.164679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:38.168215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.181474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201a9ba-9873-47f5-9b8e-c4f76a35fdfa admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:38.186825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:38.187904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.188292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.188673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] PATH_INFO: `/v3/users/c721ef04a2644c419175215f5bece27d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.190263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c721ef04a2644c419175215f5bece27d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:38.193185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:38.221804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6a7a12fe-5f9f-482b-bfb1-5bb5277bc4b1 None None] MFA Rules not processed for user `58cda7941c4a4453a5a4ae9921e5585c`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:38.224115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6a7a12fe-5f9f-482b-bfb1-5bb5277bc4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.328491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 981/1987] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:38.329932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ef6e9-a18f-47aa-ac17-f6fddba6f323 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.330328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ef6e9-a18f-47aa-ac17-f6fddba6f323 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.330680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ef6e9-a18f-47aa-ac17-f6fddba6f323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.355642 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-616ef6e9-a18f-47aa-ac17-f6fddba6f323 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:38.357165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-616ef6e9-a18f-47aa-ac17-f6fddba6f323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.367098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 982/1988] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:38.368372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ef6e9-a18f-47aa-ac17-f6fddba6f323 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:38.369853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-616ef6e9-a18f-47aa-ac17-f6fddba6f323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.386216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ef6e9-a18f-47aa-ac17-f6fddba6f323 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:38.392008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:38.392959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.393421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.394040 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.395695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:38.397675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:38.421310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 983/1989] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:38.421310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:38.423845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.448473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d2040-e04a-4466-bcb3-9306fd847c4a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:38.455850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726cc99-2675-4c9b-b93f-1148d15947dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:38.456163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726cc99-2675-4c9b-b93f-1148d15947dc admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.456593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726cc99-2675-4c9b-b93f-1148d15947dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.457531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726cc99-2675-4c9b-b93f-1148d15947dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.458442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726cc99-2675-4c9b-b93f-1148d15947dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:38.475703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726cc99-2675-4c9b-b93f-1148d15947dc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:38.563731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c721ef04a2644c419175215f5bece27d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.564697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c721ef04a2644c419175215f5bece27d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.565323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c721ef04a2644c419175215f5bece27d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.714050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c721ef04a2644c419175215f5bece27d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.722825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 984/1990] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:38 2022] POST /identity/v3/projects => generated 387 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:38.724611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f845-1ee8-4fbb-b9cf-539ea8a3fb82 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.724902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f845-1ee8-4fbb-b9cf-539ea8a3fb82 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.725184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f845-1ee8-4fbb-b9cf-539ea8a3fb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.730570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c721ef04a2644c419175215f5bece27d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:38.744098 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1007/1991] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:38 2022] DELETE /identity/v3/users/c721ef04a2644c419175215f5bece27d => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:38.744353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1141f845-1ee8-4fbb-b9cf-539ea8a3fb82 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:38.745028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:38.745618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1141f845-1ee8-4fbb-b9cf-539ea8a3fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.746668 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.820751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6e282-d9f1-400c-a565-354014482981 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:38.821225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 985/1992] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:38.822270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f845-1ee8-4fbb-b9cf-539ea8a3fb82 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:38.824393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1141f845-1ee8-4fbb-b9cf-539ea8a3fb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.829975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926daf9d-f4c8-4e00-9e1b-c9bb305d5009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:38.830717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926daf9d-f4c8-4e00-9e1b-c9bb305d5009 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.830999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926daf9d-f4c8-4e00-9e1b-c9bb305d5009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.831275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926daf9d-f4c8-4e00-9e1b-c9bb305d5009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.832126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926daf9d-f4c8-4e00-9e1b-c9bb305d5009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:38.833947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926daf9d-f4c8-4e00-9e1b-c9bb305d5009 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:38.848746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1008/1993] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:38.848951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f845-1ee8-4fbb-b9cf-539ea8a3fb82 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:38.849358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e23f-7cf4-4dc7-9f6f-456ea5e1f219 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.849358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e23f-7cf4-4dc7-9f6f-456ea5e1f219 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.849358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e23f-7cf4-4dc7-9f6f-456ea5e1f219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.853753 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:38.854475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.854771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.855151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.855830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:38.857890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:38.870649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-46f5e23f-7cf4-4dc7-9f6f-456ea5e1f219 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:38.871864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-46f5e23f-7cf4-4dc7-9f6f-456ea5e1f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:38.880966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1009/1994] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:38.882772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5e23f-7cf4-4dc7-9f6f-456ea5e1f219 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:38.895366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5e23f-7cf4-4dc7-9f6f-456ea5e1f219 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:38.898403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:38.899086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.899366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.899640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.900385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:38.900748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:38.902393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:38.915737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1010/1995] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:38.916721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:38.929513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec71e7-92ca-48bc-920f-90ad403f549a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:38.934859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6cfa7-88ab-4b49-b6c6-ca98dc751c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:38.935817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6cfa7-88ab-4b49-b6c6-ca98dc751c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:38.936293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6cfa7-88ab-4b49-b6c6-ca98dc751c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:38.936408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6cfa7-88ab-4b49-b6c6-ca98dc751c73 admin admin] PATH_INFO: `/v3/projects/688cc48e40c24a9db06dbb6e582d765e/users/3fe88b98a37d452089e78474b2863201/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:38.957100 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6cfa7-88ab-4b49-b6c6-ca98dc751c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688cc48e40c24a9db06dbb6e582d765e, user_id=3fe88b98a37d452089e78474b2863201, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:38.960216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6cfa7-88ab-4b49-b6c6-ca98dc751c73 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:38.978656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 986/1996] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:38 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:38.982381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:38.984752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:39.051381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62c294-5674-48e5-b91d-5da87f977afa admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.056394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded7980-d4d7-4d30-9254-d86a2e2835a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.057481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded7980-d4d7-4d30-9254-d86a2e2835a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.057939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded7980-d4d7-4d30-9254-d86a2e2835a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.058341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded7980-d4d7-4d30-9254-d86a2e2835a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.076334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded7980-d4d7-4d30-9254-d86a2e2835a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.078658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded7980-d4d7-4d30-9254-d86a2e2835a4 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.088364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1011/1997] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:38 2022] PUT /identity/v3/projects/688cc48e40c24a9db06dbb6e582d765e/users/3fe88b98a37d452089e78474b2863201/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:39.089404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6cfa7-88ab-4b49-b6c6-ca98dc751c73 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.093200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 987/1998] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:39.093841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded7980-d4d7-4d30-9254-d86a2e2835a4 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.104659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded7980-d4d7-4d30-9254-d86a2e2835a4 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.188296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6cfa7-88ab-4b49-b6c6-ca98dc751c73 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.188610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9d9e-e9b8-4ac8-97f9-ef056b176e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.189524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9d9e-e9b8-4ac8-97f9-ef056b176e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.189814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9d9e-e9b8-4ac8-97f9-ef056b176e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.190151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9d9e-e9b8-4ac8-97f9-ef056b176e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.192633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be9d9e-e9b8-4ac8-97f9-ef056b176e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.195001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be9d9e-e9b8-4ac8-97f9-ef056b176e6a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.196566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89369f0-56e8-4877-a8c7-c92afaf2fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.197540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89369f0-56e8-4877-a8c7-c92afaf2fad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.198299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89369f0-56e8-4877-a8c7-c92afaf2fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.198698 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89369f0-56e8-4877-a8c7-c92afaf2fad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.199791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89369f0-56e8-4877-a8c7-c92afaf2fad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.214406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89369f0-56e8-4877-a8c7-c92afaf2fad5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.214661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 988/1999] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:39.214661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1502-b374-4917-9a8d-50a1de12414b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.214661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1502-b374-4917-9a8d-50a1de12414b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.214661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb1502-b374-4917-9a8d-50a1de12414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.241802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7ddb1502-b374-4917-9a8d-50a1de12414b None None] MFA Rules not processed for user `3fe88b98a37d452089e78474b2863201`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:39.243132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7ddb1502-b374-4917-9a8d-50a1de12414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:39.315160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 989/2000] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:39.316765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1502-b374-4917-9a8d-50a1de12414b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.327256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb1502-b374-4917-9a8d-50a1de12414b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.344095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aa561-89e1-46f7-9452-427ebaa952c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.345150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa561-89e1-46f7-9452-427ebaa952c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.345941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1012/2001] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:39 2022] POST /identity/v3/projects => generated 355 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:39.346216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa561-89e1-46f7-9452-427ebaa952c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.346631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aa561-89e1-46f7-9452-427ebaa952c5 admin admin] PATH_INFO: `/v3/projects/9adb2c040e9748fe8e639186fc730178/users/62d9f5184aa2448183f36d9bdeb82266/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.347248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89369f0-56e8-4877-a8c7-c92afaf2fad5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.374122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619aa561-89e1-46f7-9452-427ebaa952c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9adb2c040e9748fe8e639186fc730178, user_id=62d9f5184aa2448183f36d9bdeb82266, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.380092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619aa561-89e1-46f7-9452-427ebaa952c5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.467091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89369f0-56e8-4877-a8c7-c92afaf2fad5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.474291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf39ee8-660f-48e4-b235-e621da542512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.474964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf39ee8-660f-48e4-b235-e621da542512 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.475409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf39ee8-660f-48e4-b235-e621da542512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.475696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf39ee8-660f-48e4-b235-e621da542512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.476625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf39ee8-660f-48e4-b235-e621da542512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.479709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf39ee8-660f-48e4-b235-e621da542512 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.492132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:39.503214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 990/2002] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:39 2022] PUT /identity/v3/projects/9adb2c040e9748fe8e639186fc730178/users/62d9f5184aa2448183f36d9bdeb82266/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:39.503214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aa561-89e1-46f7-9452-427ebaa952c5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.605112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aa561-89e1-46f7-9452-427ebaa952c5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.606205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1013/2003] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:39 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:39.608271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf39ee8-660f-48e4-b235-e621da542512 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.673961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.674785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.675133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.676440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.677152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.681885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.705711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf39ee8-660f-48e4-b235-e621da542512 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.711311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64cace-e695-4af6-a7a3-99cce4de34ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.712002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64cace-e695-4af6-a7a3-99cce4de34ed admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.712287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64cace-e695-4af6-a7a3-99cce4de34ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.712565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64cace-e695-4af6-a7a3-99cce4de34ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.713310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64cace-e695-4af6-a7a3-99cce4de34ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.714983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64cace-e695-4af6-a7a3-99cce4de34ed admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.725775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1014/2004] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:39.726672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64cace-e695-4af6-a7a3-99cce4de34ed admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.737360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64cace-e695-4af6-a7a3-99cce4de34ed admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.743509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6caca-3210-406b-a020-602004814202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.744198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6caca-3210-406b-a020-602004814202 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.744481 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6caca-3210-406b-a020-602004814202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.744762 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6caca-3210-406b-a020-602004814202 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.745475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6caca-3210-406b-a020-602004814202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.750195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6caca-3210-406b-a020-602004814202 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.780406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 991/2005] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:39 2022] POST /identity/v3/users => generated 278 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:39.780406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.780406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:39.792898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f224f6-634e-4987-8e18-4a0de7d79efc admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.794435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:39.797749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.798660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.798950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.799241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] PATH_INFO: `/v3/projects/1766b1eec4df4fef87ca5c6d20eaf9fe` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.801071 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1766b1eec4df4fef87ca5c6d20eaf9fe)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.803114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.863475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1015/2006] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:39 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:39.864309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6caca-3210-406b-a020-602004814202 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.874334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6caca-3210-406b-a020-602004814202 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:39.879311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe45a21-d7aa-4247-bf50-6a687400b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:39.880338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45a21-d7aa-4247-bf50-6a687400b0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:39.880637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45a21-d7aa-4247-bf50-6a687400b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:39.880908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45a21-d7aa-4247-bf50-6a687400b0ae admin admin] PATH_INFO: `/v3/projects/9adb2c040e9748fe8e639186fc730178/users/62d9f5184aa2448183f36d9bdeb82266/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:39.883034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe45a21-d7aa-4247-bf50-6a687400b0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9adb2c040e9748fe8e639186fc730178, user_id=62d9f5184aa2448183f36d9bdeb82266, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:39.885675 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe45a21-d7aa-4247-bf50-6a687400b0ae admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:39.897395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1016/2007] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:39 2022] PUT /identity/v3/projects/9adb2c040e9748fe8e639186fc730178/users/62d9f5184aa2448183f36d9bdeb82266/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:39.898150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe45a21-d7aa-4247-bf50-6a687400b0ae admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:39.963887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1766b1eec4df4fef87ca5c6d20eaf9fe', 'request_id': 'req-085c22f4-da55-4cf7-98a6-7a2064092176'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:39.970286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1766b1eec4df4fef87ca5c6d20eaf9fe', 'request_id': 'req-085c22f4-da55-4cf7-98a6-7a2064092176'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:39.981218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe45a21-d7aa-4247-bf50-6a687400b0ae admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.041215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaeff4-02cb-4c00-9710-91cf1aa480dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.041903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaeff4-02cb-4c00-9710-91cf1aa480dc admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.042226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaeff4-02cb-4c00-9710-91cf1aa480dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.042507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaeff4-02cb-4c00-9710-91cf1aa480dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.043242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaeff4-02cb-4c00-9710-91cf1aa480dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.044831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaeff4-02cb-4c00-9710-91cf1aa480dc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.055936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1017/2008] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:40.056798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaeff4-02cb-4c00-9710-91cf1aa480dc admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:40.066730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaeff4-02cb-4c00-9710-91cf1aa480dc admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.071441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072413c-1619-4419-82ca-fcf97484c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.072135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072413c-1619-4419-82ca-fcf97484c736 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.072424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072413c-1619-4419-82ca-fcf97484c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.072695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072413c-1619-4419-82ca-fcf97484c736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.073426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072413c-1619-4419-82ca-fcf97484c736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.073563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1766b1eec4df4fef87ca5c6d20eaf9fe', 'request_id': 'req-085c22f4-da55-4cf7-98a6-7a2064092176'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:40.075047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072413c-1619-4419-82ca-fcf97484c736 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.086669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] The token cache is being invalidate because project 1766b1eec4df4fef87ca5c6d20eaf9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:40.086967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:40.087647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:40.093922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1018/2010] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:40.094713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 992/2010] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:39 2022] DELETE /identity/v3/projects/1766b1eec4df4fef87ca5c6d20eaf9fe => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:40.094713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:40.094960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a169dc-8905-441e-a190-24b35b8de157 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.094960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a169dc-8905-441e-a190-24b35b8de157 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.095109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:40.095550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a169dc-8905-441e-a190-24b35b8de157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.110656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c22f4-da55-4cf7-98a6-7a2064092176 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.116661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.117344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.117630 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.118035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.118765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.120440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.134120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 993/2011] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:40.134120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:40.135198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:40.141560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-86a169dc-8905-441e-a190-24b35b8de157 None None] MFA Rules not processed for user `62d9f5184aa2448183f36d9bdeb82266`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:40.143030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-86a169dc-8905-441e-a190-24b35b8de157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:40.153410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba48c-d634-4578-907a-bfc5c7068f69 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.159482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.160711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.161006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.161318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] PATH_INFO: `/v3/users/49a9b7ee68784b85b24647605d3908c2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.162887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a9b7ee68784b85b24647605d3908c2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.164880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.232286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1019/2012] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:40.233160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a169dc-8905-441e-a190-24b35b8de157 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:40.234752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-86a169dc-8905-441e-a190-24b35b8de157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:40.248592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a169dc-8905-441e-a190-24b35b8de157 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.266132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778255d5-d2b9-4881-a03c-38fe2849d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.266132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778255d5-d2b9-4881-a03c-38fe2849d24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.266132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778255d5-d2b9-4881-a03c-38fe2849d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.266132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778255d5-d2b9-4881-a03c-38fe2849d24b admin admin] PATH_INFO: `/v3/projects/fa3bc392fb844a5c8077d8b27cbd3ef5/users/99827463804e410fa009c1b11dcfa28d/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.276069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778255d5-d2b9-4881-a03c-38fe2849d24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3bc392fb844a5c8077d8b27cbd3ef5, user_id=99827463804e410fa009c1b11dcfa28d, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.279031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778255d5-d2b9-4881-a03c-38fe2849d24b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.355416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1020/2013] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:40 2022] PUT /identity/v3/projects/fa3bc392fb844a5c8077d8b27cbd3ef5/users/99827463804e410fa009c1b11dcfa28d/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:40.356251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778255d5-d2b9-4881-a03c-38fe2849d24b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:40.393217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a9b7ee68784b85b24647605d3908c2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:40.393942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a9b7ee68784b85b24647605d3908c2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:40.402159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a9b7ee68784b85b24647605d3908c2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:40.402889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a9b7ee68784b85b24647605d3908c2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:40.429842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778255d5-d2b9-4881-a03c-38fe2849d24b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.435620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.436533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.436819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.437101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] PATH_INFO: `/v3/projects/2acfbc669ce74c5cbf4fb0636672269d/users/dc0df76f14c94fd8a9a6f0fd369e7faa/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.453395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2acfbc669ce74c5cbf4fb0636672269d, user_id=dc0df76f14c94fd8a9a6f0fd369e7faa, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.456105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.462501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a9b7ee68784b85b24647605d3908c2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:40.482868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 994/2014] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:40 2022] DELETE /identity/v3/users/49a9b7ee68784b85b24647605d3908c2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:40.483704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:40.485349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:40.572996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b9a2-743f-4ece-81ea-786be5b898b0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.576797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a1e7e-0059-4ea6-875c-e129cc72a3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.577452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1e7e-0059-4ea6-875c-e129cc72a3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.577733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1e7e-0059-4ea6-875c-e129cc72a3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.578018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a1e7e-0059-4ea6-875c-e129cc72a3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.579960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-594a1e7e-0059-4ea6-875c-e129cc72a3b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:40.615286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1021/2015] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:40 2022] PUT /identity/v3/projects/2acfbc669ce74c5cbf4fb0636672269d/users/dc0df76f14c94fd8a9a6f0fd369e7faa/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:40.616333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:40.618186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:40.673608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a1e7e-0059-4ea6-875c-e129cc72a3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.676355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a1e7e-0059-4ea6-875c-e129cc72a3b2 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.690392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 995/2016] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:40.692028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6a70-8956-4210-a9b9-0eeba2702b85 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.692428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6a70-8956-4210-a9b9-0eeba2702b85 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.692952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba6a70-8956-4210-a9b9-0eeba2702b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.698895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3b1f8-d9b4-4aef-abf5-c07c18c59f34 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.707491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408bbea-eaae-4d48-8b00-da6e13eee1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.711424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bbea-eaae-4d48-8b00-da6e13eee1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.711424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bbea-eaae-4d48-8b00-da6e13eee1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.711424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408bbea-eaae-4d48-8b00-da6e13eee1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.711424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408bbea-eaae-4d48-8b00-da6e13eee1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.711424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408bbea-eaae-4d48-8b00-da6e13eee1fb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.738600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1022/2017] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:40.740426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408bbea-eaae-4d48-8b00-da6e13eee1fb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:40.751272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-28ba6a70-8956-4210-a9b9-0eeba2702b85 None None] MFA Rules not processed for user `dc0df76f14c94fd8a9a6f0fd369e7faa`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:40.752611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-28ba6a70-8956-4210-a9b9-0eeba2702b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:40.752977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408bbea-eaae-4d48-8b00-da6e13eee1fb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:40.760257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757461b-1f8b-4eaa-a84e-a5b8e82c055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:40.761234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757461b-1f8b-4eaa-a84e-a5b8e82c055d admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.763665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757461b-1f8b-4eaa-a84e-a5b8e82c055d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.763665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757461b-1f8b-4eaa-a84e-a5b8e82c055d admin admin] PATH_INFO: `/v3/projects/fa3bc392fb844a5c8077d8b27cbd3ef5/users/99827463804e410fa009c1b11dcfa28d/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.765570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757461b-1f8b-4eaa-a84e-a5b8e82c055d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3bc392fb844a5c8077d8b27cbd3ef5, user_id=99827463804e410fa009c1b11dcfa28d, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:40.769794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757461b-1f8b-4eaa-a84e-a5b8e82c055d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:40.783442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:40.794605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1023/2018] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:40 2022] PUT /identity/v3/projects/fa3bc392fb844a5c8077d8b27cbd3ef5/users/99827463804e410fa009c1b11dcfa28d/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:40.806092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df829240-39c0-4830-98ab-e4683380f039 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:40.806973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df829240-39c0-4830-98ab-e4683380f039 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:40.807290 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df829240-39c0-4830-98ab-e4683380f039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:40.838589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-df829240-39c0-4830-98ab-e4683380f039 None None] MFA Rules not processed for user `99827463804e410fa009c1b11dcfa28d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:40.840219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-df829240-39c0-4830-98ab-e4683380f039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:41.258128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 996/2019] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:40 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:41.259093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1024/2020] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:01:41.259293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba6a70-8956-4210-a9b9-0eeba2702b85 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:41.259293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-28ba6a70-8956-4210-a9b9-0eeba2702b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:41.260070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df829240-39c0-4830-98ab-e4683380f039 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:41.260070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-df829240-39c0-4830-98ab-e4683380f039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:41.260559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba6a70-8956-4210-a9b9-0eeba2702b85 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:41.260654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df829240-39c0-4830-98ab-e4683380f039 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:41.260654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:41.260654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.260654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.260993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] PATH_INFO: `/v3/users/58cda7941c4a4453a5a4ae9921e5585c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.260993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58cda7941c4a4453a5a4ae9921e5585c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:41.260993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:41.261315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ddbd9-12ad-473c-902d-96bfd2ba3c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:41.261315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ddbd9-12ad-473c-902d-96bfd2ba3c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.261315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ddbd9-12ad-473c-902d-96bfd2ba3c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.261315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ddbd9-12ad-473c-902d-96bfd2ba3c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.261640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ddbd9-12ad-473c-902d-96bfd2ba3c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:41.261640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ddbd9-12ad-473c-902d-96bfd2ba3c26 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:41.368027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 997/2021] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:41 2022] POST /identity/v3/projects => generated 357 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:41.375613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ddbd9-12ad-473c-902d-96bfd2ba3c26 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:41.427515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ddbd9-12ad-473c-902d-96bfd2ba3c26 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:41.431264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45bd52-da13-4d08-bccb-1b1c45cb4cf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:41.431924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45bd52-da13-4d08-bccb-1b1c45cb4cf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.432208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45bd52-da13-4d08-bccb-1b1c45cb4cf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.432484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45bd52-da13-4d08-bccb-1b1c45cb4cf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.499941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45bd52-da13-4d08-bccb-1b1c45cb4cf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:41.501452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45bd52-da13-4d08-bccb-1b1c45cb4cf4 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:41.512666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 998/2022] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:41.513451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45bd52-da13-4d08-bccb-1b1c45cb4cf4 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:41.589229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45bd52-da13-4d08-bccb-1b1c45cb4cf4 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:41.594379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:41.595103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.595393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.595672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.596383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:41.601777 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:41.671333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58cda7941c4a4453a5a4ae9921e5585c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:41.672012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58cda7941c4a4453a5a4ae9921e5585c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:41.672650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58cda7941c4a4453a5a4ae9921e5585c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:41.701685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 999/2023] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:41 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:41.701685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:41.703035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:41.716067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17f548-92dc-4803-bd08-27111f87527f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:41.721694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:41.723417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.723733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.724018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] PATH_INFO: `/v3/projects/7da961a023a94421a611d63b13d52c50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.725302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da961a023a94421a611d63b13d52c50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:41.727437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:41.759231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58cda7941c4a4453a5a4ae9921e5585c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:41.773307 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58cda7941c4a4453a5a4ae9921e5585c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:41.787213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1025/2024] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:41 2022] DELETE /identity/v3/users/58cda7941c4a4453a5a4ae9921e5585c => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:41.788071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:41.789560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:41.851035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16cfe6-9c8f-4a80-91a6-0ec09fc8cc99 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:41.854890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:41.859990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:41.859990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:41.859990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:41.859990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:41.866580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da961a023a94421a611d63b13d52c50', 'request_id': 'req-4f041f0d-c788-4b12-a299-c651e3a637cb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:41.872221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da961a023a94421a611d63b13d52c50', 'request_id': 'req-4f041f0d-c788-4b12-a299-c651e3a637cb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:41.926932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:41.928402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:41.938722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1026/2025] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:41.939564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:41.940996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:41.988377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da961a023a94421a611d63b13d52c50', 'request_id': 'req-4f041f0d-c788-4b12-a299-c651e3a637cb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:42.006175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] The token cache is being invalidate because project 7da961a023a94421a611d63b13d52c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:42.006473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:42.007219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4f041f0d-c788-4b12-a299-c651e3a637cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:42.008862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1000/2026] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:41 2022] DELETE /identity/v3/projects/7da961a023a94421a611d63b13d52c50 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:42.010205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33233e2a-a99a-4658-9532-4c06ad007412 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.010489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33233e2a-a99a-4658-9532-4c06ad007412 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.010765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33233e2a-a99a-4658-9532-4c06ad007412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.027598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b8354-cd0b-4efb-a395-208fa2d996db service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.030714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-33233e2a-a99a-4658-9532-4c06ad007412 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:42.032000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-33233e2a-a99a-4658-9532-4c06ad007412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:42.101776 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.102600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.102888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.103166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.103732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1001/2027] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:42.104081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.105866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.108249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e774-eebc-4d29-8760-dc8c71369efc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.109005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e774-eebc-4d29-8760-dc8c71369efc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.109301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e774-eebc-4d29-8760-dc8c71369efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.122656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1027/2028] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:42.123604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.126011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:42.148581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9d47e774-eebc-4d29-8760-dc8c71369efc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:42.153051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9d47e774-eebc-4d29-8760-dc8c71369efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:42.178742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1002/2029] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:42.179710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47e774-eebc-4d29-8760-dc8c71369efc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.181198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9d47e774-eebc-4d29-8760-dc8c71369efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:42.194896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47e774-eebc-4d29-8760-dc8c71369efc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.195404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc5cf-446e-4f4d-99ba-a588e3642cb6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.199825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639465e0-d670-4359-b8c6-7c04c449f802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.200483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639465e0-d670-4359-b8c6-7c04c449f802 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.200812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639465e0-d670-4359-b8c6-7c04c449f802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.201093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639465e0-d670-4359-b8c6-7c04c449f802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.202644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cef340-765b-4bf4-a806-1f7b8d24b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.204214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cef340-765b-4bf4-a806-1f7b8d24b2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.207194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cef340-765b-4bf4-a806-1f7b8d24b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.207194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cef340-765b-4bf4-a806-1f7b8d24b2cb admin admin] PATH_INFO: `/v3/projects/9217692d7d8b40c2847ca5997ae45ba4/users/1b8602b7b491422fa283f2532743bc48/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.211922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639465e0-d670-4359-b8c6-7c04c449f802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.213353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639465e0-d670-4359-b8c6-7c04c449f802 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.225976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cef340-765b-4bf4-a806-1f7b8d24b2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9217692d7d8b40c2847ca5997ae45ba4, user_id=1b8602b7b491422fa283f2532743bc48, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.229026 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cef340-765b-4bf4-a806-1f7b8d24b2cb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.231541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1028/2030] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:42.235356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd17dea-2e83-4648-bee4-6278c8892e48 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.235356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd17dea-2e83-4648-bee4-6278c8892e48 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.235356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd17dea-2e83-4648-bee4-6278c8892e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.266762 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-dbd17dea-2e83-4648-bee4-6278c8892e48 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:42.268002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dbd17dea-2e83-4648-bee4-6278c8892e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:42.278365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1029/2031] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:42.282471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd17dea-2e83-4648-bee4-6278c8892e48 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.294077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd17dea-2e83-4648-bee4-6278c8892e48 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.302333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.303013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.303317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.303594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.304417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:42.304738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.306387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.321585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1030/2032] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:01:42.325165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.337081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39115815-485f-4e9f-b4ac-4adfa36c39c8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.345514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e5dd-970a-4a56-87cd-662c56a2bad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.346731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e5dd-970a-4a56-87cd-662c56a2bad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.350836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e5dd-970a-4a56-87cd-662c56a2bad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.350836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e5dd-970a-4a56-87cd-662c56a2bad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.350836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2e5dd-970a-4a56-87cd-662c56a2bad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.354093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1003/2033] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:42 2022] PUT /identity/v3/projects/9217692d7d8b40c2847ca5997ae45ba4/users/1b8602b7b491422fa283f2532743bc48/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:42.354245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2e5dd-970a-4a56-87cd-662c56a2bad8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.354347 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cef340-765b-4bf4-a806-1f7b8d24b2cb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.447380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cef340-765b-4bf4-a806-1f7b8d24b2cb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.452742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.453483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.453985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.454197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.454811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.456964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.473966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1004/2034] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:42.473966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.476686 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:42.498001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eeaf6-3c59-459d-acf1-7f5e12de5b78 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.504429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.521528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.521528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.521528 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] PATH_INFO: `/v3/users/9046458fa4ce4d0f844f9d35d2d683e7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.522332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1031/2035] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:42 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:42.522332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e5dd-970a-4a56-87cd-662c56a2bad8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.522501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9046458fa4ce4d0f844f9d35d2d683e7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.522574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:42.522655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.591281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e5dd-970a-4a56-87cd-662c56a2bad8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.596782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29151e8c-20c3-47a4-9866-0fca7da0cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.598901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151e8c-20c3-47a4-9866-0fca7da0cda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.604057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151e8c-20c3-47a4-9866-0fca7da0cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.604057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29151e8c-20c3-47a4-9866-0fca7da0cda0 admin admin] PATH_INFO: `/v3/projects/9217692d7d8b40c2847ca5997ae45ba4/users/1b8602b7b491422fa283f2532743bc48/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.604057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29151e8c-20c3-47a4-9866-0fca7da0cda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9217692d7d8b40c2847ca5997ae45ba4, user_id=1b8602b7b491422fa283f2532743bc48, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.604592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29151e8c-20c3-47a4-9866-0fca7da0cda0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.616864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1032/2036] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:42 2022] PUT /identity/v3/projects/9217692d7d8b40c2847ca5997ae45ba4/users/1b8602b7b491422fa283f2532743bc48/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:42.617693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29151e8c-20c3-47a4-9866-0fca7da0cda0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.703844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29151e8c-20c3-47a4-9866-0fca7da0cda0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.709343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78585d6-88ae-4e6c-8079-3b421d8110e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.710097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78585d6-88ae-4e6c-8079-3b421d8110e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.710382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78585d6-88ae-4e6c-8079-3b421d8110e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.710814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78585d6-88ae-4e6c-8079-3b421d8110e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.711369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78585d6-88ae-4e6c-8079-3b421d8110e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.713342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78585d6-88ae-4e6c-8079-3b421d8110e8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.824720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1033/2037] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:42 2022] POST /identity/v3/users => generated 284 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:42.824720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7449-0eaf-40bd-b4ad-10367d8165e3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.824720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7449-0eaf-40bd-b4ad-10367d8165e3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.824720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a7449-0eaf-40bd-b4ad-10367d8165e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.843765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9046458fa4ce4d0f844f9d35d2d683e7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:42.846176 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:42.847311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9046458fa4ce4d0f844f9d35d2d683e7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:42.858565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0b0a7449-0eaf-40bd-b4ad-10367d8165e3 None None] MFA Rules not processed for user `1b8602b7b491422fa283f2532743bc48`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:42.865095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0b0a7449-0eaf-40bd-b4ad-10367d8165e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:42.866934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9046458fa4ce4d0f844f9d35d2d683e7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:42.867744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9046458fa4ce4d0f844f9d35d2d683e7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:42.934887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1034/2038] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:42 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:42.934887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a7449-0eaf-40bd-b4ad-10367d8165e3 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.934887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0b0a7449-0eaf-40bd-b4ad-10367d8165e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:42.952859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a7449-0eaf-40bd-b4ad-10367d8165e3 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:42.958432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:42.962354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:42.962354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:42.962354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] PATH_INFO: `/v3/projects/f10b89c75ff24bd98694370587720885` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:42.962621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9046458fa4ce4d0f844f9d35d2d683e7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:42.962808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10b89c75ff24bd98694370587720885)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:42.963119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:42.983398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1005/2039] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:42 2022] DELETE /identity/v3/users/9046458fa4ce4d0f844f9d35d2d683e7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:42.984703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:42.986430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:43.058477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7d076-9a36-44b9-902a-e591755af3ef admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:43.065034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:43.066550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.067024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.067512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.068819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:43.071423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:43.085448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1006/2040] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:43.086693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:43.089460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:43.148394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10b89c75ff24bd98694370587720885', 'request_id': 'req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:43.157004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10b89c75ff24bd98694370587720885', 'request_id': 'req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:43.164101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10b89c75ff24bd98694370587720885', 'request_id': 'req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:43.178515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1c719-a55c-4b58-bb2c-049d10d3b12a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:43.244873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6828d03-759e-48d7-b00e-0f7d76139be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:43.245543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6828d03-759e-48d7-b00e-0f7d76139be4 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.245830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6828d03-759e-48d7-b00e-0f7d76139be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.246164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6828d03-759e-48d7-b00e-0f7d76139be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.274740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] The token cache is being invalidate because project f10b89c75ff24bd98694370587720885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:43.275669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:43.277914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f689d7f7-e8fa-400a-8c5a-2b11461f9ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:43.284065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1035/2041] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:42 2022] DELETE /identity/v3/projects/f10b89c75ff24bd98694370587720885 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:43.284065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e29b6-c846-49be-acab-50bdfef2ac11 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.285141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e29b6-c846-49be-acab-50bdfef2ac11 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.285287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e29b6-c846-49be-acab-50bdfef2ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.311580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-269e29b6-c846-49be-acab-50bdfef2ac11 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:43.311580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-269e29b6-c846-49be-acab-50bdfef2ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:43.319308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6828d03-759e-48d7-b00e-0f7d76139be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:43.320996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6828d03-759e-48d7-b00e-0f7d76139be4 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:43.331966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1007/2042] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:43.333107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6828d03-759e-48d7-b00e-0f7d76139be4 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:43.411463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6828d03-759e-48d7-b00e-0f7d76139be4 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:43.414221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1036/2043] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:43.414221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e29b6-c846-49be-acab-50bdfef2ac11 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:43.418152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-269e29b6-c846-49be-acab-50bdfef2ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:43.420177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:43.421110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.421785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.422357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.423296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:43.425741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:43.433964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e29b6-c846-49be-acab-50bdfef2ac11 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:43.443349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1008/2044] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:43.443349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:43.443686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:43.443686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.443686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.443686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] PATH_INFO: `/v3/users/62d9f5184aa2448183f36d9bdeb82266` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.444054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:43.448533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d9f5184aa2448183f36d9bdeb82266)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:43.450709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:43.528719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5933a56-c035-41c2-abdb-6d5a90195b24 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:43.546641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:43.546641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.546641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.546641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.554954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:43.555417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:43.566979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1009/2045] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:43.567915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:43.569296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:43.586473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3debcf-4a88-418e-bd46-e3235e22b6e9 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:43.587980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:43.588854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.589134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.589407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] PATH_INFO: `/v3/projects/8f36557e28814645b62793f7c080276f/users/9e6af76c218140be8dbdb7e098a93bff/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.606680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f36557e28814645b62793f7c080276f, user_id=9e6af76c218140be8dbdb7e098a93bff, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:43.609624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:43.866141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1010/2046] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:43 2022] PUT /identity/v3/projects/8f36557e28814645b62793f7c080276f/users/9e6af76c218140be8dbdb7e098a93bff/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:43.866141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:43.871136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:43.879540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d9f5184aa2448183f36d9bdeb82266'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:43.880805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d9f5184aa2448183f36d9bdeb82266'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:43.881466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d9f5184aa2448183f36d9bdeb82266'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:43.939227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdaa5bb-e00a-471b-ba83-e190694e35b5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:43.943471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f20809-bb17-4b35-ac9b-dda7764ae1b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:43.943888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20809-bb17-4b35-ac9b-dda7764ae1b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:43.944302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20809-bb17-4b35-ac9b-dda7764ae1b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:43.944415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f20809-bb17-4b35-ac9b-dda7764ae1b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:43.946568 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d0f20809-bb17-4b35-ac9b-dda7764ae1b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:44.018238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f20809-bb17-4b35-ac9b-dda7764ae1b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:44.020817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f20809-bb17-4b35-ac9b-dda7764ae1b7 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:44.036875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1011/2047] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:44.039246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6206f-8654-41c8-9708-2aa66dc9c62f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:44.039731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6206f-8654-41c8-9708-2aa66dc9c62f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:44.040486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6206f-8654-41c8-9708-2aa66dc9c62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:44.073465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d9f5184aa2448183f36d9bdeb82266'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:44.079189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a5c6206f-8654-41c8-9708-2aa66dc9c62f None None] MFA Rules not processed for user `9e6af76c218140be8dbdb7e098a93bff`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:44.080665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a5c6206f-8654-41c8-9708-2aa66dc9c62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:44.098248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d9f5184aa2448183f36d9bdeb82266'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:44.131408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1037/2048] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:43 2022] DELETE /identity/v3/users/62d9f5184aa2448183f36d9bdeb82266 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:44.171348 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1012/2049] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:44.177194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:44.178737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:44.215429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:44.228717 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6206f-8654-41c8-9708-2aa66dc9c62f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:44.231098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a5c6206f-8654-41c8-9708-2aa66dc9c62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:44.290189 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c3026-df6e-467f-bf96-2b2dd49608ee admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:44.310975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d6b9-5fb5-4a3f-a375-44b2dd0c1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:44.310975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d6b9-5fb5-4a3f-a375-44b2dd0c1045 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:44.310975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d6b9-5fb5-4a3f-a375-44b2dd0c1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:44.310975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02d6b9-5fb5-4a3f-a375-44b2dd0c1045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:44.311519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02d6b9-5fb5-4a3f-a375-44b2dd0c1045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:44.311519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02d6b9-5fb5-4a3f-a375-44b2dd0c1045 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:44.367598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6206f-8654-41c8-9708-2aa66dc9c62f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:44.372013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:44.372899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:44.373184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:44.373468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] PATH_INFO: `/v3/projects/d0a9937e76a440caa5abd1a5ea9ca1c3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:44.374739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a9937e76a440caa5abd1a5ea9ca1c3)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:44.376659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:44.487804 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1038/2050] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:44 2022] POST /identity/v3/projects => generated 365 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:44.493890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d6b9-5fb5-4a3f-a375-44b2dd0c1045 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:44.579039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02d6b9-5fb5-4a3f-a375-44b2dd0c1045 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:44.586004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a5e18-0485-4dd3-a13a-c427e276dc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:44.586759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a5e18-0485-4dd3-a13a-c427e276dc59 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:44.587049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a5e18-0485-4dd3-a13a-c427e276dc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:44.587330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a5e18-0485-4dd3-a13a-c427e276dc59 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:44.588038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a5e18-0485-4dd3-a13a-c427e276dc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:44.589981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a5e18-0485-4dd3-a13a-c427e276dc59 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:44.848845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1039/2051] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:44 2022] POST /identity/v3/users => generated 289 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:01:44.879364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a5e18-0485-4dd3-a13a-c427e276dc59 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:44.884407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a9937e76a440caa5abd1a5ea9ca1c3', 'request_id': 'req-0a7460fb-3a49-4d0f-920d-57363be172db'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:44.885142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a5e18-0485-4dd3-a13a-c427e276dc59 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:44.899332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a9937e76a440caa5abd1a5ea9ca1c3', 'request_id': 'req-0a7460fb-3a49-4d0f-920d-57363be172db'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:44.985612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb657b-047c-453f-a3ee-d2161eaa6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:44.988797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb657b-047c-453f-a3ee-d2161eaa6ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:44.988797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb657b-047c-453f-a3ee-d2161eaa6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:44.988797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb657b-047c-453f-a3ee-d2161eaa6ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:44.989760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb657b-047c-453f-a3ee-d2161eaa6ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:44.992494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb657b-047c-453f-a3ee-d2161eaa6ae7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.010327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1040/2052] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:45.014874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb657b-047c-453f-a3ee-d2161eaa6ae7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:45.028065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb657b-047c-453f-a3ee-d2161eaa6ae7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:45.034035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780482-8daa-418e-854e-5bf39cf9d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:45.035611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780482-8daa-418e-854e-5bf39cf9d2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.035916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780482-8daa-418e-854e-5bf39cf9d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.036320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d780482-8daa-418e-854e-5bf39cf9d2f8 admin admin] PATH_INFO: `/v3/projects/748fabe4d36d41298f09925ebc136cd4/users/e5ca435555904b549fe16e69f94a6ddd/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.055812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d780482-8daa-418e-854e-5bf39cf9d2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748fabe4d36d41298f09925ebc136cd4, user_id=e5ca435555904b549fe16e69f94a6ddd, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:45.058671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d780482-8daa-418e-854e-5bf39cf9d2f8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.062711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a9937e76a440caa5abd1a5ea9ca1c3', 'request_id': 'req-0a7460fb-3a49-4d0f-920d-57363be172db'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:45.078388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] The token cache is being invalidate because project d0a9937e76a440caa5abd1a5ea9ca1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:45.078388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:45.078388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0a7460fb-3a49-4d0f-920d-57363be172db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:45.079308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1013/2053] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:44 2022] DELETE /identity/v3/projects/d0a9937e76a440caa5abd1a5ea9ca1c3 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:45.084428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa453e0-980f-4616-83a9-bc28d68cc3ab None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.084716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa453e0-980f-4616-83a9-bc28d68cc3ab None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.084997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa453e0-980f-4616-83a9-bc28d68cc3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.107261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9aa453e0-980f-4616-83a9-bc28d68cc3ab None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:45.110537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9aa453e0-980f-4616-83a9-bc28d68cc3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:45.119774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1014/2054] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:01:45.128846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a41ed-0c58-442c-91b9-07a86535bcd5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.129209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a41ed-0c58-442c-91b9-07a86535bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.129494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a41ed-0c58-442c-91b9-07a86535bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.148078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-553a41ed-0c58-442c-91b9-07a86535bcd5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:45.149313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-553a41ed-0c58-442c-91b9-07a86535bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:45.157723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1015/2055] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:01:45.162922 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a41ed-0c58-442c-91b9-07a86535bcd5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:45.171994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a41ed-0c58-442c-91b9-07a86535bcd5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:45.177625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:45.178311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.178594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.178866 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.179598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:45.179900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:45.181496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.205226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1016/2056] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:01:45.206819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:45.210678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:45.224721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541e0a9-f4c5-4776-aede-9631b241e031 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:45.238724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1041/2057] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:45 2022] PUT /identity/v3/projects/748fabe4d36d41298f09925ebc136cd4/users/e5ca435555904b549fe16e69f94a6ddd/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:45.238724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780482-8daa-418e-854e-5bf39cf9d2f8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:45.243834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:45.244638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.244931 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.245210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] PATH_INFO: `/v3/projects/9adb2c040e9748fe8e639186fc730178` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.246688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9adb2c040e9748fe8e639186fc730178)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:45.248577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.310947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d780482-8daa-418e-854e-5bf39cf9d2f8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:45.316197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:45.316873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.317328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.317613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.318356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:45.320258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.540861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1042/2058] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:45 2022] POST /identity/v3/projects => generated 391 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:45.540861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:45.540861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:45.555841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9adb2c040e9748fe8e639186fc730178', 'request_id': 'req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:45.562042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9adb2c040e9748fe8e639186fc730178', 'request_id': 'req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:45.613366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a4cff-77e1-4826-b78c-4cdbaaa1f3c0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:45.620531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5005bb-fab7-4a09-8d75-d1cb1dbe2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:45.621285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5005bb-fab7-4a09-8d75-d1cb1dbe2059 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.621566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5005bb-fab7-4a09-8d75-d1cb1dbe2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.621841 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5005bb-fab7-4a09-8d75-d1cb1dbe2059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.622619 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5005bb-fab7-4a09-8d75-d1cb1dbe2059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:45.624212 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5005bb-fab7-4a09-8d75-d1cb1dbe2059 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.638734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1043/2059] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:45.639979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5005bb-fab7-4a09-8d75-d1cb1dbe2059 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:45.656354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5005bb-fab7-4a09-8d75-d1cb1dbe2059 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:45.663301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2e1b-1329-4e41-a40d-4a756dbf71ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:45.663988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2e1b-1329-4e41-a40d-4a756dbf71ac admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.664269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2e1b-1329-4e41-a40d-4a756dbf71ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.664545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee2e1b-1329-4e41-a40d-4a756dbf71ac admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.665263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee2e1b-1329-4e41-a40d-4a756dbf71ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:45.667454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee2e1b-1329-4e41-a40d-4a756dbf71ac admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.774802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9adb2c040e9748fe8e639186fc730178', 'request_id': 'req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:45.778037 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1044/2060] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:45 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:45.778722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2e1b-1329-4e41-a40d-4a756dbf71ac admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:45.792417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee2e1b-1329-4e41-a40d-4a756dbf71ac admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:45.800665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054126e-8ae0-43b6-861e-b9d494c20b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:45.801812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054126e-8ae0-43b6-861e-b9d494c20b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.802322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054126e-8ae0-43b6-861e-b9d494c20b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.802730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054126e-8ae0-43b6-861e-b9d494c20b55 admin admin] PATH_INFO: `/v3/projects/748fabe4d36d41298f09925ebc136cd4/users/e5ca435555904b549fe16e69f94a6ddd/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.805284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054126e-8ae0-43b6-861e-b9d494c20b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748fabe4d36d41298f09925ebc136cd4, user_id=e5ca435555904b549fe16e69f94a6ddd, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:45.805598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] The token cache is being invalidate because project 9adb2c040e9748fe8e639186fc730178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:45.806078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:45.807014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:45.808321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054126e-8ae0-43b6-861e-b9d494c20b55 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.811188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1017/2061] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:45 2022] DELETE /identity/v3/projects/9adb2c040e9748fe8e639186fc730178 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:45.812868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:45.816493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:45.832965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1045/2062] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:45 2022] PUT /identity/v3/projects/748fabe4d36d41298f09925ebc136cd4/users/e5ca435555904b549fe16e69f94a6ddd/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:45.834526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05de65-08b4-4465-a074-24ed096174dc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.834913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05de65-08b4-4465-a074-24ed096174dc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.835296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05de65-08b4-4465-a074-24ed096174dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.865149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6e05de65-08b4-4465-a074-24ed096174dc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:45.867338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6e05de65-08b4-4465-a074-24ed096174dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:45.910822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ec3f6-f5f1-4ee2-8ebf-aed69b6f6197 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:45.957669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1046/2063] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:45.959132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae7c0e-2b3d-49d3-bab0-894250f99c07 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.959490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae7c0e-2b3d-49d3-bab0-894250f99c07 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.959817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae7c0e-2b3d-49d3-bab0-894250f99c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.994588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fd2e2-60fc-4cd2-a7c5-39bf30da95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:45.995283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fd2e2-60fc-4cd2-a7c5-39bf30da95a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:45.995567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fd2e2-60fc-4cd2-a7c5-39bf30da95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:45.995724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-07ae7c0e-2b3d-49d3-bab0-894250f99c07 None None] MFA Rules not processed for user `e5ca435555904b549fe16e69f94a6ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:45.995845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fd2e2-60fc-4cd2-a7c5-39bf30da95a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:45.996945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fd2e2-60fc-4cd2-a7c5-39bf30da95a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:45.998245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fd2e2-60fc-4cd2-a7c5-39bf30da95a4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:45.998363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-07ae7c0e-2b3d-49d3-bab0-894250f99c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:46.016900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1018/2064] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:46.019730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea082-5b03-4759-bea6-1f72914404c9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.019906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea082-5b03-4759-bea6-1f72914404c9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.020480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea082-5b03-4759-bea6-1f72914404c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.051916 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d02ea082-5b03-4759-bea6-1f72914404c9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:46.053159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d02ea082-5b03-4759-bea6-1f72914404c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:46.067445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1019/2065] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:46.067445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea082-5b03-4759-bea6-1f72914404c9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.075166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea082-5b03-4759-bea6-1f72914404c9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.077369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:46.087162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568ec7-7b55-436a-8fae-f2c7cfaec15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.088347 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568ec7-7b55-436a-8fae-f2c7cfaec15f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.088787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568ec7-7b55-436a-8fae-f2c7cfaec15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.089205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568ec7-7b55-436a-8fae-f2c7cfaec15f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.089654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1047/2066] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:46.090294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50568ec7-7b55-436a-8fae-f2c7cfaec15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.091914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50568ec7-7b55-436a-8fae-f2c7cfaec15f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.094737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae7c0e-2b3d-49d3-bab0-894250f99c07 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.106966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1020/2067] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:46.108165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae7c0e-2b3d-49d3-bab0-894250f99c07 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.115543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.116285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.116618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.116905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.117097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568ec7-7b55-436a-8fae-f2c7cfaec15f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.117864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:46.118131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.120380 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.129162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568ec7-7b55-436a-8fae-f2c7cfaec15f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.135051 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1048/2068] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:46.144798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.144798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.144798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.144798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] PATH_INFO: `/v3/projects/c6b3d00c34314d4299cc4dd6b8e8fa09/users/e95e2bd778e94a36a8debf4c4c798560/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.151553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.163594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66189d-3092-4b65-b4cd-065c85735dc2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.164833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b3d00c34314d4299cc4dd6b8e8fa09, user_id=e95e2bd778e94a36a8debf4c4c798560, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.168005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.168826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c3120-b8ed-423f-8c20-1475813be41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.169829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3120-b8ed-423f-8c20-1475813be41a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.170318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3120-b8ed-423f-8c20-1475813be41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.170742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3120-b8ed-423f-8c20-1475813be41a admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.171894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c3120-b8ed-423f-8c20-1475813be41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.174034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c3120-b8ed-423f-8c20-1475813be41a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.281981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1021/2069] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:46 2022] PUT /identity/v3/projects/c6b3d00c34314d4299cc4dd6b8e8fa09/users/e95e2bd778e94a36a8debf4c4c798560/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:46.281981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.281981 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:46.338384 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1049/2070] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:46 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:46.339288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af7d78-df14-424f-acb6-44acc15ae1da admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.339691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39e40-0224-40a6-b4a8-9f1431c24246 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.339983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39e40-0224-40a6-b4a8-9f1431c24246 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.340381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea39e40-0224-40a6-b4a8-9f1431c24246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.387131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8ea39e40-0224-40a6-b4a8-9f1431c24246 None None] MFA Rules not processed for user `e95e2bd778e94a36a8debf4c4c798560`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:46.388385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8ea39e40-0224-40a6-b4a8-9f1431c24246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:46.414920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.415598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.416148 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.416431 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.463761 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1050/2071] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:46.466456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea39e40-0224-40a6-b4a8-9f1431c24246 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.485496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.487037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.498485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1022/2072] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:46.528251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:46.540028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea39e40-0224-40a6-b4a8-9f1431c24246 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.544981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917998bf-7dd6-4dec-9cb5-083325616991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.545726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917998bf-7dd6-4dec-9cb5-083325616991 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.546180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917998bf-7dd6-4dec-9cb5-083325616991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.546608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917998bf-7dd6-4dec-9cb5-083325616991 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.547331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917998bf-7dd6-4dec-9cb5-083325616991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.549275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917998bf-7dd6-4dec-9cb5-083325616991 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.655603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.657205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:46.669369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e320cb9-ee73-4b07-ab7f-e44f4000b0b8 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.673115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da2597-d177-4763-9993-27572042aab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.673758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2597-d177-4763-9993-27572042aab9 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.674035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2597-d177-4763-9993-27572042aab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.674338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da2597-d177-4763-9993-27572042aab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.685356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da2597-d177-4763-9993-27572042aab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.685356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da2597-d177-4763-9993-27572042aab9 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.695293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1023/2073] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:01:46.848486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1051/2074] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:46 2022] POST /identity/v3/users => generated 292 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:46.853519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da2597-d177-4763-9993-27572042aab9 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.870605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da2597-d177-4763-9993-27572042aab9 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.877669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddce0-f24f-4918-acfc-86b9bf1c69d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.878726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddce0-f24f-4918-acfc-86b9bf1c69d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.879293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddce0-f24f-4918-acfc-86b9bf1c69d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.879681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ddce0-f24f-4918-acfc-86b9bf1c69d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.880521 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ddce0-f24f-4918-acfc-86b9bf1c69d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.882413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ddce0-f24f-4918-acfc-86b9bf1c69d7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.895653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1024/2075] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:46.899793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917998bf-7dd6-4dec-9cb5-083325616991 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.913156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917998bf-7dd6-4dec-9cb5-083325616991 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.919547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dc36-dd99-4636-b22b-730b311a7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.920316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dc36-dd99-4636-b22b-730b311a7bda admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.920684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dc36-dd99-4636-b22b-730b311a7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.921056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dc36-dd99-4636-b22b-730b311a7bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.921908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9dc36-dd99-4636-b22b-730b311a7bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.923766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9dc36-dd99-4636-b22b-730b311a7bda admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:46.936012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1052/2076] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:46.940190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddce0-f24f-4918-acfc-86b9bf1c69d7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:46.951907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ddce0-f24f-4918-acfc-86b9bf1c69d7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:46.958520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d703a-fe85-40ef-b781-f4edec3fea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:46.959514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d703a-fe85-40ef-b781-f4edec3fea90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:46.960390 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d703a-fe85-40ef-b781-f4edec3fea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:46.960390 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d703a-fe85-40ef-b781-f4edec3fea90 admin admin] PATH_INFO: `/v3/projects/0e6fc4f718504a3581f0246f5d93604a/users/6dc9b97d5d824f1391894c09667992e1/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:46.978411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d703a-fe85-40ef-b781-f4edec3fea90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6fc4f718504a3581f0246f5d93604a, user_id=6dc9b97d5d824f1391894c09667992e1, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:46.982101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d703a-fe85-40ef-b781-f4edec3fea90 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:47.015745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dc36-dd99-4636-b22b-730b311a7bda admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:47.031726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dc36-dd99-4636-b22b-730b311a7bda admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:47.036947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:47.037691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:47.041614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:47.041614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:47.041614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:47.080519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1025/2077] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:46 2022] PUT /identity/v3/projects/0e6fc4f718504a3581f0246f5d93604a/users/6dc9b97d5d824f1391894c09667992e1/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:47.091604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f5876-dc5f-45ef-b88f-b86bc5fde426 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:47.091903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f5876-dc5f-45ef-b88f-b86bc5fde426 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:47.092189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f5876-dc5f-45ef-b88f-b86bc5fde426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:47.130771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-040f5876-dc5f-45ef-b88f-b86bc5fde426 None None] MFA Rules not processed for user `6dc9b97d5d824f1391894c09667992e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:47.132325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-040f5876-dc5f-45ef-b88f-b86bc5fde426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:47.156059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:47.159191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:47.174985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1053/2078] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:01:47.252325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1026/2079] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:47.257696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:47.274679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98181a9-d39b-4a6b-97bf-b26f52796553 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:47.345744 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f363c13-9cce-47a3-bde0-19cbf39d1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:47.346444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363c13-9cce-47a3-bde0-19cbf39d1239 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:47.346837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363c13-9cce-47a3-bde0-19cbf39d1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:47.347051 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f363c13-9cce-47a3-bde0-19cbf39d1239 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:47.348159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f363c13-9cce-47a3-bde0-19cbf39d1239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:47.350090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f363c13-9cce-47a3-bde0-19cbf39d1239 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:47.573411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1054/2080] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:47 2022] POST /identity/v3/projects => generated 385 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:47.577829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f5876-dc5f-45ef-b88f-b86bc5fde426 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:47.589959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f5876-dc5f-45ef-b88f-b86bc5fde426 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:47.653579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546b831-176f-41ab-bbde-b284ec010166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:47.654298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b831-176f-41ab-bbde-b284ec010166 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:47.654587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b831-176f-41ab-bbde-b284ec010166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:47.654865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b831-176f-41ab-bbde-b284ec010166 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:47.655562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546b831-176f-41ab-bbde-b284ec010166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:47.657513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546b831-176f-41ab-bbde-b284ec010166 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:47.808244 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1027/2081] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:47 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:47.813429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f363c13-9cce-47a3-bde0-19cbf39d1239 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:47.832839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f363c13-9cce-47a3-bde0-19cbf39d1239 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:47.843433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:47.845337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:47.845633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:47.845918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:47.846873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:47.850259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:47.867592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1055/2082] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:47.871798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546b831-176f-41ab-bbde-b284ec010166 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:47.883265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546b831-176f-41ab-bbde-b284ec010166 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:47.888008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f36b-eee8-498e-a9ed-5a13488a7087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:47.888991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f36b-eee8-498e-a9ed-5a13488a7087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:47.889175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f36b-eee8-498e-a9ed-5a13488a7087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:47.889499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f36b-eee8-498e-a9ed-5a13488a7087 admin admin] PATH_INFO: `/v3/projects/a81fd4f638f7444e9f1034a4aa27d739/users/f56267b56f414ce384846132b1bb5d50/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:47.907462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1f36b-eee8-498e-a9ed-5a13488a7087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81fd4f638f7444e9f1034a4aa27d739, user_id=f56267b56f414ce384846132b1bb5d50, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:47.910595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1f36b-eee8-498e-a9ed-5a13488a7087 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:47.985952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:47.988625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:48.002715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8544bbe-b547-41e2-b326-ff50516c670f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:48.006983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:48.024908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:48.025787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.026522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.026976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] PATH_INFO: `/v3/users/ba3e7b7d81094e93bd88d6b23861f126` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.028683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3e7b7d81094e93bd88d6b23861f126)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:48.031197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:48.045803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1028/2083] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:47 2022] PUT /identity/v3/projects/a81fd4f638f7444e9f1034a4aa27d739/users/f56267b56f414ce384846132b1bb5d50/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:48.050637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f36b-eee8-498e-a9ed-5a13488a7087 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:48.153779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f36b-eee8-498e-a9ed-5a13488a7087 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:48.158947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f833a-2a6d-4c1d-82ad-2864b28ed443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:48.160140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f833a-2a6d-4c1d-82ad-2864b28ed443 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.160418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f833a-2a6d-4c1d-82ad-2864b28ed443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.160973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f833a-2a6d-4c1d-82ad-2864b28ed443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.161776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f833a-2a6d-4c1d-82ad-2864b28ed443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:48.163669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f833a-2a6d-4c1d-82ad-2864b28ed443 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:48.174700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1029/2084] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:01:48.179895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f833a-2a6d-4c1d-82ad-2864b28ed443 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:48.192377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f833a-2a6d-4c1d-82ad-2864b28ed443 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:48.195968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6caa7-06f8-41a8-bb9d-692703bd5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:48.203482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6caa7-06f8-41a8-bb9d-692703bd5548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.203482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6caa7-06f8-41a8-bb9d-692703bd5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.203482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6caa7-06f8-41a8-bb9d-692703bd5548 admin admin] PATH_INFO: `/v3/projects/a81fd4f638f7444e9f1034a4aa27d739/users/f56267b56f414ce384846132b1bb5d50/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.203482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6caa7-06f8-41a8-bb9d-692703bd5548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81fd4f638f7444e9f1034a4aa27d739, user_id=f56267b56f414ce384846132b1bb5d50, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:48.203482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6caa7-06f8-41a8-bb9d-692703bd5548 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:48.237548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1030/2085] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:48 2022] PUT /identity/v3/projects/a81fd4f638f7444e9f1034a4aa27d739/users/f56267b56f414ce384846132b1bb5d50/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:48.239999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d0c4-0dcc-402f-96b8-2e4887f87324 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.240355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d0c4-0dcc-402f-96b8-2e4887f87324 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.240652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d0c4-0dcc-402f-96b8-2e4887f87324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.278432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c1a0d0c4-0dcc-402f-96b8-2e4887f87324 None None] MFA Rules not processed for user `f56267b56f414ce384846132b1bb5d50`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:48.279790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c1a0d0c4-0dcc-402f-96b8-2e4887f87324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:48.331605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3e7b7d81094e93bd88d6b23861f126'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:48.332755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3e7b7d81094e93bd88d6b23861f126'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:48.333477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3e7b7d81094e93bd88d6b23861f126'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:48.377622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1031/2086] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:48.397886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:48.404637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d0c4-0dcc-402f-96b8-2e4887f87324 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:48.406796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c1a0d0c4-0dcc-402f-96b8-2e4887f87324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:48.444900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3e7b7d81094e93bd88d6b23861f126'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:48.465261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c35195cd-307c-40bc-8350-4d685a245aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3e7b7d81094e93bd88d6b23861f126'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:48.499807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1056/2087] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:47 2022] DELETE /identity/v3/users/ba3e7b7d81094e93bd88d6b23861f126 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:48.502328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7980b-ac9b-47ac-979a-e5fb0ed689dc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.502624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7980b-ac9b-47ac-979a-e5fb0ed689dc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.503042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7980b-ac9b-47ac-979a-e5fb0ed689dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.531097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d0c4-0dcc-402f-96b8-2e4887f87324 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:48.538222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a2d7980b-ac9b-47ac-979a-e5fb0ed689dc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:48.539879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a2d7980b-ac9b-47ac-979a-e5fb0ed689dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:48.619454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:48.621043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.621043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.621043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.622135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1057/2088] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:48.625952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:48.632431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7980b-ac9b-47ac-979a-e5fb0ed689dc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:48.633961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a2d7980b-ac9b-47ac-979a-e5fb0ed689dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:48.697699 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:48.699560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:48.709734 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1032/2089] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:48.717334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7980b-ac9b-47ac-979a-e5fb0ed689dc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:48.721592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eda3a-9106-4d3f-92cd-b87288333fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:48.722895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eda3a-9106-4d3f-92cd-b87288333fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:48.723236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eda3a-9106-4d3f-92cd-b87288333fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:48.723514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eda3a-9106-4d3f-92cd-b87288333fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:48.735065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eda3a-9106-4d3f-92cd-b87288333fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:48.736650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eda3a-9106-4d3f-92cd-b87288333fe5 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:48.754086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1058/2090] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:01:49.454299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:49.456936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:49.511050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8ab6b-0fc4-4be0-b499-2ce1f31eaa79 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:49.527048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:49.539792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:49.539792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:49.539792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] PATH_INFO: `/v3/projects/17e6dd1c5d754835bc279e65d6c5a7ed` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:49.539792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e6dd1c5d754835bc279e65d6c5a7ed)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:49.539792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:49.802175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e6dd1c5d754835bc279e65d6c5a7ed', 'request_id': 'req-c4f94ea9-553d-440e-8add-e48151b17834'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:49.808110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e6dd1c5d754835bc279e65d6c5a7ed', 'request_id': 'req-c4f94ea9-553d-440e-8add-e48151b17834'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:49.925819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e6dd1c5d754835bc279e65d6c5a7ed', 'request_id': 'req-c4f94ea9-553d-440e-8add-e48151b17834'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:50.042855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] The token cache is being invalidate because project 17e6dd1c5d754835bc279e65d6c5a7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:50.042855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:50.042855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:50.042855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1033/2091] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:49 2022] DELETE /identity/v3/projects/17e6dd1c5d754835bc279e65d6c5a7ed => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:50.043940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eda3a-9106-4d3f-92cd-b87288333fe5 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:50.043940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eda3a-9106-4d3f-92cd-b87288333fe5 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:50.093688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:50.094743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:50.095118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:50.095674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] PATH_INFO: `/v3/users/3fe88b98a37d452089e78474b2863201` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:50.097747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe88b98a37d452089e78474b2863201)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:50.100958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:50.440129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe88b98a37d452089e78474b2863201'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:50.441357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe88b98a37d452089e78474b2863201'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:50.442244 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe88b98a37d452089e78474b2863201'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:50.571592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe88b98a37d452089e78474b2863201'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:50.592283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe88b98a37d452089e78474b2863201'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:50.608039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1059/2092] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:49 2022] DELETE /identity/v3/users/3fe88b98a37d452089e78474b2863201 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:51.154276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:51.476974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:51.479232 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:51.516510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f94ea9-553d-440e-8add-e48151b17834 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:51.617099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:51.618333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:51.618710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:51.619115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] PATH_INFO: `/v3/projects/688cc48e40c24a9db06dbb6e582d765e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:51.620512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688cc48e40c24a9db06dbb6e582d765e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:51.622577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:51.823385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688cc48e40c24a9db06dbb6e582d765e', 'request_id': 'req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:51.833429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688cc48e40c24a9db06dbb6e582d765e', 'request_id': 'req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:51.913694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688cc48e40c24a9db06dbb6e582d765e', 'request_id': 'req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:51.928665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] The token cache is being invalidate because project 688cc48e40c24a9db06dbb6e582d765e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:51.928946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:51.929718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:51.931359 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1034/2093] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:51 2022] DELETE /identity/v3/projects/688cc48e40c24a9db06dbb6e582d765e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:51.935910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:51.937563 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:51.954818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d1ef6-85ad-44ee-b73a-c3974431d034 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:52.031612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:52.032504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:52.032803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:52.033075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] PATH_INFO: `/v3/users/99827463804e410fa009c1b11dcfa28d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:52.034591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99827463804e410fa009c1b11dcfa28d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:52.036780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:52.307051 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99827463804e410fa009c1b11dcfa28d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:52.308607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99827463804e410fa009c1b11dcfa28d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:52.308607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99827463804e410fa009c1b11dcfa28d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:52.388253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99827463804e410fa009c1b11dcfa28d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:52.407125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7242db4b-a7b4-43e1-a20b-d60ae4de6f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99827463804e410fa009c1b11dcfa28d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:52.429115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1060/2094] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:51 2022] DELETE /identity/v3/users/99827463804e410fa009c1b11dcfa28d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:52.993638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:52.993638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:52.996294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:53.021442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81bdfe-3d1c-4fc5-b8ce-df6d965267e3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:53.091345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:53.092656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:53.093001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:53.094179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] PATH_INFO: `/v3/projects/fa3bc392fb844a5c8077d8b27cbd3ef5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:53.096003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3bc392fb844a5c8077d8b27cbd3ef5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:53.098418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:53.216846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3bc392fb844a5c8077d8b27cbd3ef5', 'request_id': 'req-81e12e7c-c771-4db6-b598-18efcc3cbbb6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:53.222774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3bc392fb844a5c8077d8b27cbd3ef5', 'request_id': 'req-81e12e7c-c771-4db6-b598-18efcc3cbbb6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:53.319514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:53.348532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3bc392fb844a5c8077d8b27cbd3ef5', 'request_id': 'req-81e12e7c-c771-4db6-b598-18efcc3cbbb6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:53.367797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] The token cache is being invalidate because project fa3bc392fb844a5c8077d8b27cbd3ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:53.368320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:53.369489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-81e12e7c-c771-4db6-b598-18efcc3cbbb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:53.371582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1035/2095] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:52 2022] DELETE /identity/v3/projects/fa3bc392fb844a5c8077d8b27cbd3ef5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:53.378544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcb730-9b5a-409b-a403-270be19c6173 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:53.387786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcb730-9b5a-409b-a403-270be19c6173 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:53.387786 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcb730-9b5a-409b-a403-270be19c6173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:53.402504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d1dcb730-9b5a-409b-a403-270be19c6173 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:53.403770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d1dcb730-9b5a-409b-a403-270be19c6173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:53.490874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1061/2096] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:01:53.504737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bf111-1c18-4511-a8e2-4d1262a5bbaa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:53.505005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bf111-1c18-4511-a8e2-4d1262a5bbaa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:53.505389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bf111-1c18-4511-a8e2-4d1262a5bbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:53.531058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1d4bf111-1c18-4511-a8e2-4d1262a5bbaa None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:53.532319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1d4bf111-1c18-4511-a8e2-4d1262a5bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:53.545475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1036/2097] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:01:53.551567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcb730-9b5a-409b-a403-270be19c6173 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:53.564159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcb730-9b5a-409b-a403-270be19c6173 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:53.587082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:53.587082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:53.587082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:53.587082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:53.587748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:53.587748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:53.587748 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:53.588798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1062/2098] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:53.598241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bf111-1c18-4511-a8e2-4d1262a5bbaa None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:53.610550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bf111-1c18-4511-a8e2-4d1262a5bbaa None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:53.618892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064516-20b6-493c-b205-9967fe158dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:53.619898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064516-20b6-493c-b205-9967fe158dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:53.620325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064516-20b6-493c-b205-9967fe158dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:53.620743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064516-20b6-493c-b205-9967fe158dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:53.621814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9064516-20b6-493c-b205-9967fe158dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:53.623901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9064516-20b6-493c-b205-9967fe158dc8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:53.836716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1037/2099] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:53 2022] POST /identity/v3/projects => generated 373 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:01:53.841200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:53.853085 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d3be-c54e-488d-9c19-bb08fc859813 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:53.932433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bde5b-2a3b-40a4-822a-86d23c37ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:53.933272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bde5b-2a3b-40a4-822a-86d23c37ca42 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:53.933598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bde5b-2a3b-40a4-822a-86d23c37ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:53.933921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bde5b-2a3b-40a4-822a-86d23c37ca42 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:53.934954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bde5b-2a3b-40a4-822a-86d23c37ca42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:53.936933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bde5b-2a3b-40a4-822a-86d23c37ca42 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:54.109725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1063/2100] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:53 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:01:54.114253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064516-20b6-493c-b205-9967fe158dc8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:54.126034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064516-20b6-493c-b205-9967fe158dc8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:54.131772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e1dc7-b477-4238-926a-aed65edd85fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:54.132488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1dc7-b477-4238-926a-aed65edd85fb admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:54.132772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1dc7-b477-4238-926a-aed65edd85fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:54.133055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e1dc7-b477-4238-926a-aed65edd85fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:54.133819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1dc7-b477-4238-926a-aed65edd85fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:54.135616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e1dc7-b477-4238-926a-aed65edd85fb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:54.153487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1038/2101] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:54.155398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bde5b-2a3b-40a4-822a-86d23c37ca42 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:54.171977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bde5b-2a3b-40a4-822a-86d23c37ca42 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:54.176605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc270409-f686-4b45-95c6-024c483e550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:54.177665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270409-f686-4b45-95c6-024c483e550b admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:54.177939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270409-f686-4b45-95c6-024c483e550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:54.178321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270409-f686-4b45-95c6-024c483e550b admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:54.179312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc270409-f686-4b45-95c6-024c483e550b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:54.181204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc270409-f686-4b45-95c6-024c483e550b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:54.196769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1064/2102] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:54.198613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e1dc7-b477-4238-926a-aed65edd85fb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:54.213677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e1dc7-b477-4238-926a-aed65edd85fb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:54.219665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:54.220685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:54.221398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:54.222667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] PATH_INFO: `/v3/projects/b8c58651e3f346f2b74104a27afe6cef/users/7a206dca37494cd4870ae86d19cee0c9/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:54.255812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c58651e3f346f2b74104a27afe6cef, user_id=7a206dca37494cd4870ae86d19cee0c9, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:54.258809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:54.418451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1039/2103] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:54 2022] PUT /identity/v3/projects/b8c58651e3f346f2b74104a27afe6cef/users/7a206dca37494cd4870ae86d19cee0c9/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:54.433644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237752dd-f006-4f44-abe6-72c641a8ee5d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:54.433936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237752dd-f006-4f44-abe6-72c641a8ee5d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:54.438969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237752dd-f006-4f44-abe6-72c641a8ee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:54.464930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-237752dd-f006-4f44-abe6-72c641a8ee5d None None] MFA Rules not processed for user `7a206dca37494cd4870ae86d19cee0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:54.466277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-237752dd-f006-4f44-abe6-72c641a8ee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:54.569941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1065/2104] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:54.583698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:54.586392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:54.668975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8d90-fbbf-4909-be9d-216dd93d2563 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:54.676882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7cda9-27c7-4e30-a9f8-cffe159681c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:54.677578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7cda9-27c7-4e30-a9f8-cffe159681c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:54.677864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7cda9-27c7-4e30-a9f8-cffe159681c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:54.678169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7cda9-27c7-4e30-a9f8-cffe159681c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:54.693323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7cda9-27c7-4e30-a9f8-cffe159681c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:54.695508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7cda9-27c7-4e30-a9f8-cffe159681c5 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:54.710585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1040/2105] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:54.732486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237752dd-f006-4f44-abe6-72c641a8ee5d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:54.846217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237752dd-f006-4f44-abe6-72c641a8ee5d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:54.853396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:54.854358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:54.858936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:54.858936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] PATH_INFO: `/v3/users/7a206dca37494cd4870ae86d19cee0c9` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:54.858936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a206dca37494cd4870ae86d19cee0c9)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:54.858936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:55.157654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a206dca37494cd4870ae86d19cee0c9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:55.158627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a206dca37494cd4870ae86d19cee0c9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:55.159678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a206dca37494cd4870ae86d19cee0c9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:55.280159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a206dca37494cd4870ae86d19cee0c9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:55.327535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a206dca37494cd4870ae86d19cee0c9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:55.378909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1066/2106] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:54 2022] DELETE /identity/v3/users/7a206dca37494cd4870ae86d19cee0c9 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:55.380187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b318-13c8-48ce-a1e1-4b824c00737e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:55.381377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b318-13c8-48ce-a1e1-4b824c00737e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:55.381842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42b318-13c8-48ce-a1e1-4b824c00737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:55.412066 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7b42b318-13c8-48ce-a1e1-4b824c00737e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:55.414199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7b42b318-13c8-48ce-a1e1-4b824c00737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:55.487662 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1041/2107] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:55.497809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:55.499402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:55.582194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eaf8d-1c11-46fe-a611-c054682b4bb1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:55.587795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925905c-105c-4ac6-a41b-f4ef34f20d3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:55.589318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925905c-105c-4ac6-a41b-f4ef34f20d3e service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:55.589644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925905c-105c-4ac6-a41b-f4ef34f20d3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:55.589955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925905c-105c-4ac6-a41b-f4ef34f20d3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:55.602147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925905c-105c-4ac6-a41b-f4ef34f20d3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:55.611335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925905c-105c-4ac6-a41b-f4ef34f20d3e service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:55.614993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1067/2108] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:56.075756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:56.369307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42b318-13c8-48ce-a1e1-4b824c00737e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:56.370824 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7b42b318-13c8-48ce-a1e1-4b824c00737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:56.385664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42b318-13c8-48ce-a1e1-4b824c00737e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:56.392614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:56.396586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:56.397156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:56.397705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] PATH_INFO: `/v3/projects/b8c58651e3f346f2b74104a27afe6cef` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:56.399816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c58651e3f346f2b74104a27afe6cef)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:56.403396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:56.592485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c58651e3f346f2b74104a27afe6cef', 'request_id': 'req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:56.602501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c58651e3f346f2b74104a27afe6cef', 'request_id': 'req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:56.892966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c58651e3f346f2b74104a27afe6cef', 'request_id': 'req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:56.919264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] The token cache is being invalidate because project b8c58651e3f346f2b74104a27afe6cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:56.919967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:56.920650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b0fe0b36-3a6b-415a-adbc-6cdfadf71eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:56.923030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1042/2109] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:56 2022] DELETE /identity/v3/projects/b8c58651e3f346f2b74104a27afe6cef => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:01:56.928612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29077a1-8750-4fbf-808e-7ca50ed1317c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:56.930647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29077a1-8750-4fbf-808e-7ca50ed1317c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:56.930647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29077a1-8750-4fbf-808e-7ca50ed1317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:56.955175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b29077a1-8750-4fbf-808e-7ca50ed1317c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:56.957486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b29077a1-8750-4fbf-808e-7ca50ed1317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:57.036293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:57.041876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1068/2110] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:57.050677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba594fcc-ed84-4019-ad5a-7a087c31f898 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:57.051013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba594fcc-ed84-4019-ad5a-7a087c31f898 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:57.051350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba594fcc-ed84-4019-ad5a-7a087c31f898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:57.078878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ba594fcc-ed84-4019-ad5a-7a087c31f898 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:57.080137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ba594fcc-ed84-4019-ad5a-7a087c31f898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:57.092154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1043/2111] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:57.104813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29077a1-8750-4fbf-808e-7ca50ed1317c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:57.115824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29077a1-8750-4fbf-808e-7ca50ed1317c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:57.121744 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:57.122536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:57.122870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:57.123269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:57.124071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:01:57.124421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:57.128213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:57.141351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1069/2112] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:01:57.152563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba594fcc-ed84-4019-ad5a-7a087c31f898 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:57.163536 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba594fcc-ed84-4019-ad5a-7a087c31f898 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:57.169466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87e11-3199-4c2c-914f-e72f06d793a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:57.170212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87e11-3199-4c2c-914f-e72f06d793a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:57.170542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87e11-3199-4c2c-914f-e72f06d793a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:57.170783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f87e11-3199-4c2c-914f-e72f06d793a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:57.172269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f87e11-3199-4c2c-914f-e72f06d793a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:57.173661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f87e11-3199-4c2c-914f-e72f06d793a8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:57.336538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1044/2113] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:01:57 2022] POST /identity/v3/projects => generated 357 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:57.344236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:57.357791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f2ea9-99b8-4584-ae95-23d53d8b641a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:57.425490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a5427-6631-403d-a544-f5bc49ca66f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:57.426204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5427-6631-403d-a544-f5bc49ca66f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:57.426490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5427-6631-403d-a544-f5bc49ca66f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:57.426771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5427-6631-403d-a544-f5bc49ca66f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:57.427472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a5427-6631-403d-a544-f5bc49ca66f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:57.429387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a5427-6631-403d-a544-f5bc49ca66f2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:57.704273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1070/2114] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:01:57 2022] POST /identity/v3/users => generated 279 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:01:57.721240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87e11-3199-4c2c-914f-e72f06d793a8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:57.731712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f87e11-3199-4c2c-914f-e72f06d793a8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:57.736621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9b86e-54c8-480a-b4fa-8574d5236977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:57.737898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9b86e-54c8-480a-b4fa-8574d5236977 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:57.738221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9b86e-54c8-480a-b4fa-8574d5236977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:57.738504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9b86e-54c8-480a-b4fa-8574d5236977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:57.739237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9b86e-54c8-480a-b4fa-8574d5236977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:57.740828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9b86e-54c8-480a-b4fa-8574d5236977 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:57.751491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1045/2115] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:57.756285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a5427-6631-403d-a544-f5bc49ca66f2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:57.766607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a5427-6631-403d-a544-f5bc49ca66f2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:57.772031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbade09-f937-462a-8917-d342a9c8444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:57.772773 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbade09-f937-462a-8917-d342a9c8444d admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:57.773176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbade09-f937-462a-8917-d342a9c8444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:57.773479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbade09-f937-462a-8917-d342a9c8444d admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:57.774248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbade09-f937-462a-8917-d342a9c8444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:57.775854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbade09-f937-462a-8917-d342a9c8444d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:57.789977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1071/2116] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:01:57.791109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9b86e-54c8-480a-b4fa-8574d5236977 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:57.802713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9b86e-54c8-480a-b4fa-8574d5236977 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:57.807980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:57.816645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:57.816645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:57.816645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] PATH_INFO: `/v3/projects/b13aae23957d445e99d5830b94dbce72/users/e729804f9def4b5b89fdfdaa8b0d3f42/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:57.826149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13aae23957d445e99d5830b94dbce72, user_id=e729804f9def4b5b89fdfdaa8b0d3f42, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:57.828933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:58.005194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1046/2117] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:01:57 2022] PUT /identity/v3/projects/b13aae23957d445e99d5830b94dbce72/users/e729804f9def4b5b89fdfdaa8b0d3f42/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:58.015823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482580d3-9388-4db5-a299-532a3099289f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:58.016355 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482580d3-9388-4db5-a299-532a3099289f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:58.016464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482580d3-9388-4db5-a299-532a3099289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:58.042882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-482580d3-9388-4db5-a299-532a3099289f None None] MFA Rules not processed for user `e729804f9def4b5b89fdfdaa8b0d3f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:58.044088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-482580d3-9388-4db5-a299-532a3099289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:58.124104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1072/2118] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:58.157289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:58.164217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:58.235378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d0703-36fb-4329-8bbb-ed264a359d30 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:58.244332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624017f3-4614-4fca-bc22-e4001cb0e678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:58.244332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624017f3-4614-4fca-bc22-e4001cb0e678 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:58.244332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624017f3-4614-4fca-bc22-e4001cb0e678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:58.244332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624017f3-4614-4fca-bc22-e4001cb0e678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:58.251321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624017f3-4614-4fca-bc22-e4001cb0e678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:58.253401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624017f3-4614-4fca-bc22-e4001cb0e678 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:58.263402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1047/2119] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:58 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:58.286248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482580d3-9388-4db5-a299-532a3099289f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:58.349573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482580d3-9388-4db5-a299-532a3099289f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:58.363201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:58.363201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:58.363201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:58.363201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] PATH_INFO: `/v3/users/e729804f9def4b5b89fdfdaa8b0d3f42` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:58.363656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e729804f9def4b5b89fdfdaa8b0d3f42)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:58.363656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:58.874765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e729804f9def4b5b89fdfdaa8b0d3f42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:58.875356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e729804f9def4b5b89fdfdaa8b0d3f42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:58.876053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e729804f9def4b5b89fdfdaa8b0d3f42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:58.925403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:01:58.959480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e729804f9def4b5b89fdfdaa8b0d3f42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:58.974547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e729804f9def4b5b89fdfdaa8b0d3f42'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:58.995616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1073/2120] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:01:58 2022] DELETE /identity/v3/users/e729804f9def4b5b89fdfdaa8b0d3f42 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:01:58.999097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d5a17-5155-4b41-ba49-74dee50da6d3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:58.999598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d5a17-5155-4b41-ba49-74dee50da6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:58.999704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d5a17-5155-4b41-ba49-74dee50da6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:59.017721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-870d5a17-5155-4b41-ba49-74dee50da6d3 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:01:59.018998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-870d5a17-5155-4b41-ba49-74dee50da6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:59.077142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1048/2121] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:01:59.087605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:59.089052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:59.150541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4299e-b729-40a5-a5c8-899a969b43f4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:59.154335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54016a35-2626-4fc8-85e1-e7fa092830f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:59.154986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016a35-2626-4fc8-85e1-e7fa092830f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:59.155266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016a35-2626-4fc8-85e1-e7fa092830f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:59.155540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54016a35-2626-4fc8-85e1-e7fa092830f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:59.164977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54016a35-2626-4fc8-85e1-e7fa092830f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:59.166434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54016a35-2626-4fc8-85e1-e7fa092830f0 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:59.177232 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1074/2122] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:01:59.703408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d5a17-5155-4b41-ba49-74dee50da6d3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:01:59.705264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-870d5a17-5155-4b41-ba49-74dee50da6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:01:59.717790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d5a17-5155-4b41-ba49-74dee50da6d3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:01:59.723027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:01:59.723870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:01:59.724153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:01:59.724428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] PATH_INFO: `/v3/projects/b13aae23957d445e99d5830b94dbce72` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:01:59.725695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13aae23957d445e99d5830b94dbce72)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:01:59.727651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:01:59.868909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13aae23957d445e99d5830b94dbce72', 'request_id': 'req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:59.874341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13aae23957d445e99d5830b94dbce72', 'request_id': 'req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:59.981945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13aae23957d445e99d5830b94dbce72', 'request_id': 'req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:59.994984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] The token cache is being invalidate because project b13aae23957d445e99d5830b94dbce72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:01:59.995275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:59.998417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-367e6db5-59cd-46ba-ac8d-8e6c8190ad7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:01:59.998417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1049/2123] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:01:59 2022] DELETE /identity/v3/projects/b13aae23957d445e99d5830b94dbce72 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:00.003493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf75db-c5d2-4b7d-a1ca-66e514a1d85a None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.003818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf75db-c5d2-4b7d-a1ca-66e514a1d85a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.004145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf75db-c5d2-4b7d-a1ca-66e514a1d85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.022936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b4bf75db-c5d2-4b7d-a1ca-66e514a1d85a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:00.024164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b4bf75db-c5d2-4b7d-a1ca-66e514a1d85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:00.068290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:00.090718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1075/2124] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:00.100606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb36a-6982-47e2-8e48-00d0baa20275 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.100923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb36a-6982-47e2-8e48-00d0baa20275 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.101206 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbb36a-6982-47e2-8e48-00d0baa20275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.122445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-08fbb36a-6982-47e2-8e48-00d0baa20275 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:00.123872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-08fbb36a-6982-47e2-8e48-00d0baa20275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:00.132310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1050/2125] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:00.157389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf75db-c5d2-4b7d-a1ca-66e514a1d85a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:00.172148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf75db-c5d2-4b7d-a1ca-66e514a1d85a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:00.179889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:00.180657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.181071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.181396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.182356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:00.182721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:00.184515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:00.201871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1076/2126] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:02:00.203880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb36a-6982-47e2-8e48-00d0baa20275 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:00.214769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbb36a-6982-47e2-8e48-00d0baa20275 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:00.219574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1feaf-c263-448a-b518-d4965f43ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:00.220244 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1feaf-c263-448a-b518-d4965f43ef2a admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.220525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1feaf-c263-448a-b518-d4965f43ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.220800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1feaf-c263-448a-b518-d4965f43ef2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.222154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1feaf-c263-448a-b518-d4965f43ef2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:00.224068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1feaf-c263-448a-b518-d4965f43ef2a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:00.302830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1051/2127] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:00 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:00.308870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:00.321851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:00.326198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9cb7e-c6fb-4ecc-9f97-9cf9e9d60023 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:00.458581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980e160-75e9-42d5-b74e-4195063ca42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:00.459265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980e160-75e9-42d5-b74e-4195063ca42f admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.459552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980e160-75e9-42d5-b74e-4195063ca42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.459832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980e160-75e9-42d5-b74e-4195063ca42f admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.460745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980e160-75e9-42d5-b74e-4195063ca42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:00.463328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980e160-75e9-42d5-b74e-4195063ca42f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:00.601992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1077/2128] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:00 2022] POST /identity/v3/users => generated 284 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:00.606275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1feaf-c263-448a-b518-d4965f43ef2a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:00.621417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1feaf-c263-448a-b518-d4965f43ef2a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:00.630228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9e95a-5bb8-4b3e-bd70-d4bd9fff0a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:00.631059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9e95a-5bb8-4b3e-bd70-d4bd9fff0a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.631400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9e95a-5bb8-4b3e-bd70-d4bd9fff0a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.631915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9e95a-5bb8-4b3e-bd70-d4bd9fff0a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.632920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9e95a-5bb8-4b3e-bd70-d4bd9fff0a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:00.634862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9e95a-5bb8-4b3e-bd70-d4bd9fff0a0b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:00.666669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1052/2129] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:00.669459 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980e160-75e9-42d5-b74e-4195063ca42f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:00.687813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980e160-75e9-42d5-b74e-4195063ca42f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:00.695768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864eb79-d7d9-49bc-9bf3-0f24212600ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:00.696905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864eb79-d7d9-49bc-9bf3-0f24212600ff admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.697388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864eb79-d7d9-49bc-9bf3-0f24212600ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.697819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864eb79-d7d9-49bc-9bf3-0f24212600ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.698743 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864eb79-d7d9-49bc-9bf3-0f24212600ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:00.700942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864eb79-d7d9-49bc-9bf3-0f24212600ff admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:00.717296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1078/2130] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:02:00.721369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9e95a-5bb8-4b3e-bd70-d4bd9fff0a0b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:00.731632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9e95a-5bb8-4b3e-bd70-d4bd9fff0a0b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:00.737402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:00.738784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.739167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.739576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] PATH_INFO: `/v3/projects/a04f36b2f3ed48b0abc7f86521cc0653/users/2128fdb6b2184c95899aec3582600aa9/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.758328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04f36b2f3ed48b0abc7f86521cc0653, user_id=2128fdb6b2184c95899aec3582600aa9, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:00.760980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:00.837172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1053/2131] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:00 2022] PUT /identity/v3/projects/a04f36b2f3ed48b0abc7f86521cc0653/users/2128fdb6b2184c95899aec3582600aa9/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:00.856381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d21cb-5900-4286-885e-faffc6c9acf5 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.856381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d21cb-5900-4286-885e-faffc6c9acf5 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.856840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d21cb-5900-4286-885e-faffc6c9acf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.870106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:00.871811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:00.874441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:00.897114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7f0d21cb-5900-4286-885e-faffc6c9acf5 None None] MFA Rules not processed for user `2128fdb6b2184c95899aec3582600aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:00.899162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7f0d21cb-5900-4286-885e-faffc6c9acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:00.954679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6044e-f938-4b4d-8ba7-8f2136e65032 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:00.960647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:00.961612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:00.961998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:00.962491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] PATH_INFO: `/v3/users/9e6af76c218140be8dbdb7e098a93bff` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:00.963870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6af76c218140be8dbdb7e098a93bff)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:00.966037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:00.972362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1079/2132] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:00.985898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d21cb-5900-4286-885e-faffc6c9acf5 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:00.987741 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7f0d21cb-5900-4286-885e-faffc6c9acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:01.049604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d21cb-5900-4286-885e-faffc6c9acf5 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:01.054175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d86c29-c859-4aff-a72d-12e9a469b068 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb36ac7a2e4643009bc1b0ca599203f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:01.054850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d86c29-c859-4aff-a72d-12e9a469b068 service glance] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:01.055132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d86c29-c859-4aff-a72d-12e9a469b068 service glance] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:01.055410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d86c29-c859-4aff-a72d-12e9a469b068 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:01.065528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d86c29-c859-4aff-a72d-12e9a469b068 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:01.067800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d86c29-c859-4aff-a72d-12e9a469b068 service glance] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:01.078033 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1080/2133] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:02:01.181056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6af76c218140be8dbdb7e098a93bff'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:01.181764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6af76c218140be8dbdb7e098a93bff'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:01.200906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6af76c218140be8dbdb7e098a93bff'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:01.201939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6af76c218140be8dbdb7e098a93bff'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:01.278917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6af76c218140be8dbdb7e098a93bff'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:01.303368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1054/2134] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:00 2022] DELETE /identity/v3/users/9e6af76c218140be8dbdb7e098a93bff => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:01.307655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a6aa-2cc9-4bcb-b0d6-868b46d623a6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:01.308181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a6aa-2cc9-4bcb-b0d6-868b46d623a6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:01.308271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a6aa-2cc9-4bcb-b0d6-868b46d623a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:01.328543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-48c2a6aa-2cc9-4bcb-b0d6-868b46d623a6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:01.329976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-48c2a6aa-2cc9-4bcb-b0d6-868b46d623a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:01.350511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:01.414128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1081/2135] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:01.424010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:01.426640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:01.504235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af30bc-6cec-4b07-b79d-9e21b8d71830 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:01.506563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5dd58-4631-4a70-94ee-820ad97fd12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:01.507318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5dd58-4631-4a70-94ee-820ad97fd12b service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:01.507671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5dd58-4631-4a70-94ee-820ad97fd12b service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:01.508021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5dd58-4631-4a70-94ee-820ad97fd12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:01.518950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:01.524233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5dd58-4631-4a70-94ee-820ad97fd12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:01.526721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5dd58-4631-4a70-94ee-820ad97fd12b service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:01.543320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1055/2136] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:02.017465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:02.134588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a6aa-2cc9-4bcb-b0d6-868b46d623a6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:02.136031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-48c2a6aa-2cc9-4bcb-b0d6-868b46d623a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:02.163377 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a6aa-2cc9-4bcb-b0d6-868b46d623a6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:02.173180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:02.173180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:02.173180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:02.173180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] PATH_INFO: `/v3/projects/8f36557e28814645b62793f7c080276f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:02.174832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f36557e28814645b62793f7c080276f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:02.188276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:02.357692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f36557e28814645b62793f7c080276f', 'request_id': 'req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.368760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f36557e28814645b62793f7c080276f', 'request_id': 'req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.375778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f36557e28814645b62793f7c080276f', 'request_id': 'req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.471644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] The token cache is being invalidate because project 8f36557e28814645b62793f7c080276f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:02.472620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.472620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.474269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1082/2137] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:02 2022] DELETE /identity/v3/projects/8f36557e28814645b62793f7c080276f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:02.478416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5dd58-4631-4a70-94ee-820ad97fd12b service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:02.489603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5dd58-4631-4a70-94ee-820ad97fd12b service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:02.563450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:02.564421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:02.565208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:02.565546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] PATH_INFO: `/v3/users/e5ca435555904b549fe16e69f94a6ddd` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:02.566868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ca435555904b549fe16e69f94a6ddd)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:02.569026 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:02.742389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:02.786039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ca435555904b549fe16e69f94a6ddd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.786743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ca435555904b549fe16e69f94a6ddd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.793914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ca435555904b549fe16e69f94a6ddd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.794779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ca435555904b549fe16e69f94a6ddd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.891257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2448962-2bae-4181-9f0d-436fe2094fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ca435555904b549fe16e69f94a6ddd'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:02.930344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1056/2138] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:02 2022] DELETE /identity/v3/users/e5ca435555904b549fe16e69f94a6ddd => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:02.976413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:03.613184 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:03.615624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:03.653129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce488b8-8c4f-41e6-8baf-af8ff57a2edf admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:03.766480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:03.768580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:03.769162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:03.769693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] PATH_INFO: `/v3/projects/748fabe4d36d41298f09925ebc136cd4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:03.774172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748fabe4d36d41298f09925ebc136cd4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:03.774172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:04.022221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748fabe4d36d41298f09925ebc136cd4', 'request_id': 'req-4645a409-941d-4f66-9bfe-07d6189f4898'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:04.028633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748fabe4d36d41298f09925ebc136cd4', 'request_id': 'req-4645a409-941d-4f66-9bfe-07d6189f4898'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:04.035116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748fabe4d36d41298f09925ebc136cd4', 'request_id': 'req-4645a409-941d-4f66-9bfe-07d6189f4898'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:04.188895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] The token cache is being invalidate because project 748fabe4d36d41298f09925ebc136cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:04.189391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:04.190723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4645a409-941d-4f66-9bfe-07d6189f4898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:04.192558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1083/2139] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:03 2022] DELETE /identity/v3/projects/748fabe4d36d41298f09925ebc136cd4 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:04.197937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e675d-cc38-456a-b1b5-cd7340d26e66 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:04.200308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e675d-cc38-456a-b1b5-cd7340d26e66 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:04.200894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e675d-cc38-456a-b1b5-cd7340d26e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:04.227248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d04e675d-cc38-456a-b1b5-cd7340d26e66 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:04.230295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d04e675d-cc38-456a-b1b5-cd7340d26e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:04.323951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1057/2140] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:04.332107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cd831-6a6d-4218-8909-c6ebe93f447c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:04.332400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cd831-6a6d-4218-8909-c6ebe93f447c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:04.332685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cd831-6a6d-4218-8909-c6ebe93f447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:04.352175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3d3cd831-6a6d-4218-8909-c6ebe93f447c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:04.353417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3d3cd831-6a6d-4218-8909-c6ebe93f447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:04.365401 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1084/2141] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:02:04.370101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e675d-cc38-456a-b1b5-cd7340d26e66 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:04.382711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e675d-cc38-456a-b1b5-cd7340d26e66 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:04.388012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:04.388911 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:04.389186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:04.389467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:04.390266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:04.390658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:04.392443 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:04.410085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1058/2142] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:02:04.414832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cd831-6a6d-4218-8909-c6ebe93f447c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:04.425192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cd831-6a6d-4218-8909-c6ebe93f447c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:04.430535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:04.431224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:04.431508 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:04.431785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:04.432483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:04.434539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:04.644917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1085/2143] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:04 2022] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:04.650185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:04.666994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361317b-659c-4bff-b7d7-92fba2396dc7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:04.811462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b32365-0704-4446-9ab7-cbe45bd67ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:04.811659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b32365-0704-4446-9ab7-cbe45bd67ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:04.811939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b32365-0704-4446-9ab7-cbe45bd67ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:04.812217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b32365-0704-4446-9ab7-cbe45bd67ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:04.812936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b32365-0704-4446-9ab7-cbe45bd67ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:04.815065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b32365-0704-4446-9ab7-cbe45bd67ed0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:04.911869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:04.914909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:05.036040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe3e6c-eb9a-4f4d-a1be-07568fcd908a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:05.046636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:05.049861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:05.050789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:05.051323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:05.055006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:05.123853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1059/2144] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:04 2022] POST /identity/v3/users => generated 289 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:05.130725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b32365-0704-4446-9ab7-cbe45bd67ed0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:05.141521 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b32365-0704-4446-9ab7-cbe45bd67ed0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:05.148445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac383-1199-4ccd-aa11-7f5763a6bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:05.149223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac383-1199-4ccd-aa11-7f5763a6bec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:05.149504 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac383-1199-4ccd-aa11-7f5763a6bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:05.151842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ac383-1199-4ccd-aa11-7f5763a6bec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:05.154561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ac383-1199-4ccd-aa11-7f5763a6bec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:05.157216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ac383-1199-4ccd-aa11-7f5763a6bec8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:05.165006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:05.166891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:05.191378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1086/2145] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:02:05.193449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:05.195253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1060/2146] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:05.234982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87036aa-22a9-4944-8a34-beaf41c54c01 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:05.246360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bbebd-10c2-4db5-b2da-6456a44b69df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:05.247315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbebd-10c2-4db5-b2da-6456a44b69df admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:05.247606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbebd-10c2-4db5-b2da-6456a44b69df admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:05.248199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbebd-10c2-4db5-b2da-6456a44b69df admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:05.248837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bbebd-10c2-4db5-b2da-6456a44b69df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:05.250839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bbebd-10c2-4db5-b2da-6456a44b69df admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:05.276429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1087/2147] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:05.279829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac383-1199-4ccd-aa11-7f5763a6bec8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:05.316848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ac383-1199-4ccd-aa11-7f5763a6bec8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:05.336842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068ebc-97f0-4145-b1ea-5ac17c9a7dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:05.339763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068ebc-97f0-4145-b1ea-5ac17c9a7dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:05.340265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068ebc-97f0-4145-b1ea-5ac17c9a7dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:05.340856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d068ebc-97f0-4145-b1ea-5ac17c9a7dc0 admin admin] PATH_INFO: `/v3/projects/43e4a60890a64882b30827e25894da63/users/daf85b9a1bf642cb8bbc157aebba532f/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:05.374587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d068ebc-97f0-4145-b1ea-5ac17c9a7dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e4a60890a64882b30827e25894da63, user_id=daf85b9a1bf642cb8bbc157aebba532f, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:05.378932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d068ebc-97f0-4145-b1ea-5ac17c9a7dc0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:05.516576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1061/2148] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:05 2022] PUT /identity/v3/projects/43e4a60890a64882b30827e25894da63/users/daf85b9a1bf642cb8bbc157aebba532f/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:05.523862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519a083-063e-4eb5-8be6-3181627d45cb None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:05.524151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519a083-063e-4eb5-8be6-3181627d45cb None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:05.528593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519a083-063e-4eb5-8be6-3181627d45cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:05.563414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4519a083-063e-4eb5-8be6-3181627d45cb None None] MFA Rules not processed for user `daf85b9a1bf642cb8bbc157aebba532f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:05.564910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4519a083-063e-4eb5-8be6-3181627d45cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:05.646853 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1088/2149] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:05.651334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068ebc-97f0-4145-b1ea-5ac17c9a7dc0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:05.681710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:05.716706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d068ebc-97f0-4145-b1ea-5ac17c9a7dc0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:05.722139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72506fa1-cbb8-4063-ae23-06d0f838bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:05.722804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506fa1-cbb8-4063-ae23-06d0f838bb8b admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:05.723172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506fa1-cbb8-4063-ae23-06d0f838bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:05.723453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72506fa1-cbb8-4063-ae23-06d0f838bb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:05.724154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72506fa1-cbb8-4063-ae23-06d0f838bb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:05.726038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72506fa1-cbb8-4063-ae23-06d0f838bb8b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:05.800690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519a083-063e-4eb5-8be6-3181627d45cb None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:05.800690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4519a083-063e-4eb5-8be6-3181627d45cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:05.817838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519a083-063e-4eb5-8be6-3181627d45cb None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:05.823683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:05.824715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:05.825062 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:05.825343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] PATH_INFO: `/v3/users/b6b3995abf0047f4b9bfa7061300567e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:05.827252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b3995abf0047f4b9bfa7061300567e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:05.829333 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:05.944451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1062/2150] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:05 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:05.948417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72506fa1-cbb8-4063-ae23-06d0f838bb8b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:06.051319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72506fa1-cbb8-4063-ae23-06d0f838bb8b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:06.056465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:06.057114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:06.057413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:06.057703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:06.058448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:06.060547 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:06.234036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b3995abf0047f4b9bfa7061300567e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:06.234940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b3995abf0047f4b9bfa7061300567e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:06.235923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b3995abf0047f4b9bfa7061300567e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:06.305656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1063/2151] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:05 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:06.317811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:06.319900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:06.335104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef2ad-1381-4c5f-a083-c40b452364ee admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:06.341775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfb2dd-829b-4452-9e52-c6ddb8ca606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:06.342511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb2dd-829b-4452-9e52-c6ddb8ca606c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:06.342800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb2dd-829b-4452-9e52-c6ddb8ca606c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:06.343093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfb2dd-829b-4452-9e52-c6ddb8ca606c admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:06.344171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfb2dd-829b-4452-9e52-c6ddb8ca606c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:06.346701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfb2dd-829b-4452-9e52-c6ddb8ca606c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:06.360022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1064/2152] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:06.372715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfb2dd-829b-4452-9e52-c6ddb8ca606c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:06.385124 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfb2dd-829b-4452-9e52-c6ddb8ca606c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:06.394383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea38675-7983-452f-a0e7-f06471e7e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:06.394914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea38675-7983-452f-a0e7-f06471e7e9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:06.395231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea38675-7983-452f-a0e7-f06471e7e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:06.395879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea38675-7983-452f-a0e7-f06471e7e9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:06.396860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea38675-7983-452f-a0e7-f06471e7e9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:06.403587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea38675-7983-452f-a0e7-f06471e7e9c9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:06.417510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1065/2153] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:02:06.423199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea38675-7983-452f-a0e7-f06471e7e9c9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:06.445298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea38675-7983-452f-a0e7-f06471e7e9c9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:06.448227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:06.449211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:06.449566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:06.450586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] PATH_INFO: `/v3/projects/4df87a94e7f149539501875de37f87e3/users/bebaaffa636d4804991b8af72254ddbf/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:06.481252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df87a94e7f149539501875de37f87e3, user_id=bebaaffa636d4804991b8af72254ddbf, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:06.485315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:06.498295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:06.499203 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b3995abf0047f4b9bfa7061300567e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:06.540263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-2089b018-7ca2-4e0d-a18f-9d6cef61de33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b3995abf0047f4b9bfa7061300567e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:06.540263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1089/2154] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:05 2022] DELETE /identity/v3/users/b6b3995abf0047f4b9bfa7061300567e => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:06.740404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1066/2155] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:06 2022] PUT /identity/v3/projects/4df87a94e7f149539501875de37f87e3/users/bebaaffa636d4804991b8af72254ddbf/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:06.752269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c810e-a177-4016-b9db-a60399d1d508 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:06.752795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c810e-a177-4016-b9db-a60399d1d508 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:06.752931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c810e-a177-4016-b9db-a60399d1d508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:06.782488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f81c810e-a177-4016-b9db-a60399d1d508 None None] MFA Rules not processed for user `bebaaffa636d4804991b8af72254ddbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:06.784307 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f81c810e-a177-4016-b9db-a60399d1d508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:06.848409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:06.850221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:06.878788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1090/2156] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:06.881001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c810e-a177-4016-b9db-a60399d1d508 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:06.952519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c810e-a177-4016-b9db-a60399d1d508 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:06.955001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7d93-08f7-4731-8c72-3ce72c2a876a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:06.958155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620d3b2-986c-4452-b001-e6b8c7f656cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:06.964336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620d3b2-986c-4452-b001-e6b8c7f656cc admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:06.964336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620d3b2-986c-4452-b001-e6b8c7f656cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:06.964336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620d3b2-986c-4452-b001-e6b8c7f656cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:06.964336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620d3b2-986c-4452-b001-e6b8c7f656cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:06.964931 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:06.965103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620d3b2-986c-4452-b001-e6b8c7f656cc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:06.965249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:06.965249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:06.965249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] PATH_INFO: `/v3/projects/6257cf2b40a84e66a1d77b0b2485c462` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:06.965249 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6257cf2b40a84e66a1d77b0b2485c462)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:06.965772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.110965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1091/2157] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:06 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:07.112421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620d3b2-986c-4452-b001-e6b8c7f656cc admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.116562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6257cf2b40a84e66a1d77b0b2485c462', 'request_id': 'req-d2ef9095-88d4-416a-8936-e69e4a323fe4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:07.123842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6257cf2b40a84e66a1d77b0b2485c462', 'request_id': 'req-d2ef9095-88d4-416a-8936-e69e4a323fe4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:07.178595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620d3b2-986c-4452-b001-e6b8c7f656cc admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.183494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.184180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.187996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.187996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.187996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.187996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.277576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6257cf2b40a84e66a1d77b0b2485c462', 'request_id': 'req-d2ef9095-88d4-416a-8936-e69e4a323fe4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:07.298463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] The token cache is being invalidate because project 6257cf2b40a84e66a1d77b0b2485c462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:07.298463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:07.298463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d2ef9095-88d4-416a-8936-e69e4a323fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:07.298463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1067/2158] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:06 2022] DELETE /identity/v3/projects/6257cf2b40a84e66a1d77b0b2485c462 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:07.302097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dc6b3-70dd-4d60-8769-2c333ab62da9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.302441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dc6b3-70dd-4d60-8769-2c333ab62da9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.302744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dc6b3-70dd-4d60-8769-2c333ab62da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.329705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3a0dc6b3-70dd-4d60-8769-2c333ab62da9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:07.330971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3a0dc6b3-70dd-4d60-8769-2c333ab62da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:07.339124 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1068/2159] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:07.346803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e10d28-c577-4737-b2f1-cb752b882fa8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.347093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e10d28-c577-4737-b2f1-cb752b882fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.347373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e10d28-c577-4737-b2f1-cb752b882fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.366251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-05e10d28-c577-4737-b2f1-cb752b882fa8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:07.367418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-05e10d28-c577-4737-b2f1-cb752b882fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:07.376920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1069/2160] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:02:07.381745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e10d28-c577-4737-b2f1-cb752b882fa8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.391809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e10d28-c577-4737-b2f1-cb752b882fa8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.397060 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.397720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.398177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.398308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.399056 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:07.399364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.400990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.415123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1070/2161] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:02:07.423067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.428023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1092/2162] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:07 2022] POST /identity/v3/users => generated 295 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:07.429168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.431315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:07.436516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57250db-02af-404c-b2a2-60a43e2ea8d1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.445276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb57c-e0b3-4517-b6bb-0cc6faedab57 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.448933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef5a3b-acb9-49a7-a44a-be3f3862688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.449702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef5a3b-acb9-49a7-a44a-be3f3862688f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.450203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef5a3b-acb9-49a7-a44a-be3f3862688f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.450488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef5a3b-acb9-49a7-a44a-be3f3862688f admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.450807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a264f7-ab0e-43e7-98d3-12996a999e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.451333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef5a3b-acb9-49a7-a44a-be3f3862688f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.451645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a264f7-ab0e-43e7-98d3-12996a999e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.451933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a264f7-ab0e-43e7-98d3-12996a999e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.452216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a264f7-ab0e-43e7-98d3-12996a999e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.452951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a264f7-ab0e-43e7-98d3-12996a999e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.453614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef5a3b-acb9-49a7-a44a-be3f3862688f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.454576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a264f7-ab0e-43e7-98d3-12996a999e06 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.468878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1093/2163] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:07.470052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a264f7-ab0e-43e7-98d3-12996a999e06 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.483880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a264f7-ab0e-43e7-98d3-12996a999e06 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.490946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311258e6-bf9c-4bdd-a587-52f3995dfdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.492048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311258e6-bf9c-4bdd-a587-52f3995dfdff admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.492338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311258e6-bf9c-4bdd-a587-52f3995dfdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.492622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311258e6-bf9c-4bdd-a587-52f3995dfdff admin admin] PATH_INFO: `/v3/projects/18e60736ed0b4485b370bd799ce1277e/users/1655fdce5177426fb15244ec72465c1d/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.513096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311258e6-bf9c-4bdd-a587-52f3995dfdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e60736ed0b4485b370bd799ce1277e, user_id=1655fdce5177426fb15244ec72465c1d, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.515829 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311258e6-bf9c-4bdd-a587-52f3995dfdff admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.579376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1071/2164] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:07 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:07.586248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef5a3b-acb9-49a7-a44a-be3f3862688f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.642558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1094/2165] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:07 2022] PUT /identity/v3/projects/18e60736ed0b4485b370bd799ce1277e/users/1655fdce5177426fb15244ec72465c1d/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:07.648010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311258e6-bf9c-4bdd-a587-52f3995dfdff admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.664963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef5a3b-acb9-49a7-a44a-be3f3862688f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.743172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe0ff-fcef-49ad-96bd-3a11fb15b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.743948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe0ff-fcef-49ad-96bd-3a11fb15b781 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.744146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe0ff-fcef-49ad-96bd-3a11fb15b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.744465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe0ff-fcef-49ad-96bd-3a11fb15b781 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.745180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe0ff-fcef-49ad-96bd-3a11fb15b781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.746791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311258e6-bf9c-4bdd-a587-52f3995dfdff admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.747254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe0ff-fcef-49ad-96bd-3a11fb15b781 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.753850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21969f-ef36-4a5b-b858-44e5472a3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.754875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21969f-ef36-4a5b-b858-44e5472a3bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.755304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21969f-ef36-4a5b-b858-44e5472a3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.755824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21969f-ef36-4a5b-b858-44e5472a3bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.756767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21969f-ef36-4a5b-b858-44e5472a3bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.760478 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21969f-ef36-4a5b-b858-44e5472a3bb6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.773571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1095/2166] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:02:07.786700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21969f-ef36-4a5b-b858-44e5472a3bb6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.799850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21969f-ef36-4a5b-b858-44e5472a3bb6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.804657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb4598-6ca8-4138-866f-58a65d2e82dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.805605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb4598-6ca8-4138-866f-58a65d2e82dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.805885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb4598-6ca8-4138-866f-58a65d2e82dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.811730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb4598-6ca8-4138-866f-58a65d2e82dd admin admin] PATH_INFO: `/v3/projects/18e60736ed0b4485b370bd799ce1277e/users/1655fdce5177426fb15244ec72465c1d/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.811730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb4598-6ca8-4138-866f-58a65d2e82dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e60736ed0b4485b370bd799ce1277e, user_id=1655fdce5177426fb15244ec72465c1d, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.811730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb4598-6ca8-4138-866f-58a65d2e82dd admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.823279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1096/2167] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:07 2022] PUT /identity/v3/projects/18e60736ed0b4485b370bd799ce1277e/users/1655fdce5177426fb15244ec72465c1d/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:07.831568 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1072/2168] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:07 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:07.835398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394e1e-6dc5-456b-ba7e-59a46935246f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.835689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394e1e-6dc5-456b-ba7e-59a46935246f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.835968 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7394e1e-6dc5-456b-ba7e-59a46935246f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.840310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe0ff-fcef-49ad-96bd-3a11fb15b781 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.851660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe0ff-fcef-49ad-96bd-3a11fb15b781 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.868491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d7394e1e-6dc5-456b-ba7e-59a46935246f None None] MFA Rules not processed for user `1655fdce5177426fb15244ec72465c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:07.869889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d7394e1e-6dc5-456b-ba7e-59a46935246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:07.918160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b316008-3bed-4b0c-a3dd-c68a4d56b263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.918844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316008-3bed-4b0c-a3dd-c68a4d56b263 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.919131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316008-3bed-4b0c-a3dd-c68a4d56b263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.919409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316008-3bed-4b0c-a3dd-c68a4d56b263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.920151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b316008-3bed-4b0c-a3dd-c68a4d56b263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.921795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b316008-3bed-4b0c-a3dd-c68a4d56b263 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.933401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1073/2169] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:02:07.938602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b316008-3bed-4b0c-a3dd-c68a4d56b263 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.948879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b316008-3bed-4b0c-a3dd-c68a4d56b263 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:07.951405 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1097/2170] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:07.953947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bb99e-b85c-4229-930a-7ef2ef48d290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:07.954607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb99e-b85c-4229-930a-7ef2ef48d290 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:07.954885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb99e-b85c-4229-930a-7ef2ef48d290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:07.956471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bb99e-b85c-4229-930a-7ef2ef48d290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:07.957090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bb99e-b85c-4229-930a-7ef2ef48d290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:07.959009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bb99e-b85c-4229-930a-7ef2ef48d290 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:07.964260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7394e1e-6dc5-456b-ba7e-59a46935246f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.965753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d7394e1e-6dc5-456b-ba7e-59a46935246f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:07.975122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1074/2171] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:07.979522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bb99e-b85c-4229-930a-7ef2ef48d290 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:07.995588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bb99e-b85c-4229-930a-7ef2ef48d290 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:08.001350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:08.003131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:08.003505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:08.003933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] PATH_INFO: `/v3/projects/ec813daa61ab4ac59a2197042fb35325/users/dd07859f7aba4b908b2779af70a5f5e1/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:08.023086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec813daa61ab4ac59a2197042fb35325, user_id=dd07859f7aba4b908b2779af70a5f5e1, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:08.025453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:08.035070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7394e1e-6dc5-456b-ba7e-59a46935246f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:08.039342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95edeeb-9c7b-436b-825d-dd271517daa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:08.039998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95edeeb-9c7b-436b-825d-dd271517daa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:08.040300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95edeeb-9c7b-436b-825d-dd271517daa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:08.040577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95edeeb-9c7b-436b-825d-dd271517daa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:08.042448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d95edeeb-9c7b-436b-825d-dd271517daa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:08.104937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95edeeb-9c7b-436b-825d-dd271517daa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:08.106586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95edeeb-9c7b-436b-825d-dd271517daa0 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:08.117823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1098/2172] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:08.122369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1075/2173] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:07 2022] PUT /identity/v3/projects/ec813daa61ab4ac59a2197042fb35325/users/dd07859f7aba4b908b2779af70a5f5e1/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:08.128783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8245bf6-1eb6-43e7-b7fa-098878ccdfb0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:08.129205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8245bf6-1eb6-43e7-b7fa-098878ccdfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:08.129699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8245bf6-1eb6-43e7-b7fa-098878ccdfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:08.150579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a8245bf6-1eb6-43e7-b7fa-098878ccdfb0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:08.151869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a8245bf6-1eb6-43e7-b7fa-098878ccdfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:08.216031 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1099/2174] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:08.230205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:08.232193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:08.315491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81470f-35d0-4d0c-8c6f-4a598c34abc7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:08.320011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:08.320808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:08.321103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:08.321385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:08.332419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:08.334045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:08.344499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1076/2175] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:09.061706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:09.387173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:10.102721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:10.432061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8245bf6-1eb6-43e7-b7fa-098878ccdfb0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:10.515145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8245bf6-1eb6-43e7-b7fa-098878ccdfb0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:10.520939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:10.523310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:10.524622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:10.524622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:10.527271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:10.625004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:10.628433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:10.648836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1100/2176] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:11.052686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:12.354367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:12.988597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:12.992278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:13.014904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7f833-c453-41d9-a669-e52acc037b8e service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:13.021246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:13.021973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:13.022314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:13.022734 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:13.140151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:13.146003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:13.158358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1077/2177] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:13.517527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:13.525029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:13.556647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb517f-5e13-4b77-931e-7df253fa4ab4 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:13.564225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:13.566589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:13.567383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:13.568101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] PATH_INFO: `/v3/users/6dc9b97d5d824f1391894c09667992e1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:13.572362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc9b97d5d824f1391894c09667992e1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:13.575250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:13.611807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:13.614673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:13.653878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c4df5-f75a-4a63-b55b-69d2465a9ccf service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:13.661583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:13.664785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:13.664785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:13.664785 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] PATH_INFO: `/v3/users/e95e2bd778e94a36a8debf4c4c798560` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:13.667088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e95e2bd778e94a36a8debf4c4c798560)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:13.670416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:13.816958 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:13.987219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e95e2bd778e94a36a8debf4c4c798560'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:13.988125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e95e2bd778e94a36a8debf4c4c798560'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:13.988510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc9b97d5d824f1391894c09667992e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:13.989575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc9b97d5d824f1391894c09667992e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:13.997497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e95e2bd778e94a36a8debf4c4c798560'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:13.998730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e95e2bd778e94a36a8debf4c4c798560'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:14.006475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc9b97d5d824f1391894c09667992e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:14.119104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b67c3dec-74f0-4e17-a5f2-5f56ac01cee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e95e2bd778e94a36a8debf4c4c798560'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:14.141120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1078/2178] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:13 2022] DELETE /identity/v3/users/e95e2bd778e94a36a8debf4c4c798560 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:14.147858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c254bc-69f7-4121-8b77-49d4e208fddf None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:14.148275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c254bc-69f7-4121-8b77-49d4e208fddf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:14.150498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c254bc-69f7-4121-8b77-49d4e208fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:14.180639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d2c254bc-69f7-4121-8b77-49d4e208fddf None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:14.180639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d2c254bc-69f7-4121-8b77-49d4e208fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:14.251904 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1079/2179] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:14.262842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c254bc-69f7-4121-8b77-49d4e208fddf None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:14.264447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d2c254bc-69f7-4121-8b77-49d4e208fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:14.297364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc9b97d5d824f1391894c09667992e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:14.318792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f456215-ace1-44e0-a106-a0594e67bf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc9b97d5d824f1391894c09667992e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:14.363394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1101/2180] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:13 2022] DELETE /identity/v3/users/6dc9b97d5d824f1391894c09667992e1 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:14.369218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcf95a-06a8-491b-a5a7-31a05663ca61 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:14.369512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcf95a-06a8-491b-a5a7-31a05663ca61 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:14.369677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c254bc-69f7-4121-8b77-49d4e208fddf None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:14.369847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcf95a-06a8-491b-a5a7-31a05663ca61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:14.425334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-26bcf95a-06a8-491b-a5a7-31a05663ca61 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:14.433620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-26bcf95a-06a8-491b-a5a7-31a05663ca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:14.484469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc91d5-52cf-4bf0-9a61-1bbb8fe73f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:14.485139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc91d5-52cf-4bf0-9a61-1bbb8fe73f90 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:14.485530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc91d5-52cf-4bf0-9a61-1bbb8fe73f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:14.490138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc91d5-52cf-4bf0-9a61-1bbb8fe73f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:14.610146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1102/2181] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:14.611247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcf95a-06a8-491b-a5a7-31a05663ca61 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:14.613974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-26bcf95a-06a8-491b-a5a7-31a05663ca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:14.618599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc91d5-52cf-4bf0-9a61-1bbb8fe73f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:14.620727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc91d5-52cf-4bf0-9a61-1bbb8fe73f90 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:14.645729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1080/2182] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:02:14.649999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc91d5-52cf-4bf0-9a61-1bbb8fe73f90 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:14.659440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcf95a-06a8-491b-a5a7-31a05663ca61 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:14.664700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:14.665982 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:14.666515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:14.667000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] PATH_INFO: `/v3/users/dc0df76f14c94fd8a9a6f0fd369e7faa` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:14.668574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0df76f14c94fd8a9a6f0fd369e7faa)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:14.670865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:14.680539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc91d5-52cf-4bf0-9a61-1bbb8fe73f90 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:14.700016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b390153-8621-4821-95d0-4e91dddcd1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:14.701387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b390153-8621-4821-95d0-4e91dddcd1ab service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:14.702768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b390153-8621-4821-95d0-4e91dddcd1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:14.703221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b390153-8621-4821-95d0-4e91dddcd1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:14.730566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b390153-8621-4821-95d0-4e91dddcd1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:14.734474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b390153-8621-4821-95d0-4e91dddcd1ab service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:14.765757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1081/2183] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:14.945274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0df76f14c94fd8a9a6f0fd369e7faa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:14.946959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0df76f14c94fd8a9a6f0fd369e7faa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:14.948021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0df76f14c94fd8a9a6f0fd369e7faa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:15.069512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0df76f14c94fd8a9a6f0fd369e7faa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:15.122612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0df76f14c94fd8a9a6f0fd369e7faa'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:15.152729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1103/2184] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:14 2022] DELETE /identity/v3/users/dc0df76f14c94fd8a9a6f0fd369e7faa => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:15.159526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec81b-f6ed-4f26-8f9b-69309fd6a102 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:15.160217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec81b-f6ed-4f26-8f9b-69309fd6a102 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:15.160952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec81b-f6ed-4f26-8f9b-69309fd6a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:15.188417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9dcec81b-f6ed-4f26-8f9b-69309fd6a102 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:15.191097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9dcec81b-f6ed-4f26-8f9b-69309fd6a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:15.375871 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:15.444843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1082/2185] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:15.464807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:15.473654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:15.621349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2355704-f4cf-4865-aea5-251ed224f381 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:15.630308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:15.633004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:15.633591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:15.634245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:15.664846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec81b-f6ed-4f26-8f9b-69309fd6a102 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:15.678672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:15.679485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9dcec81b-f6ed-4f26-8f9b-69309fd6a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:15.684611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:15.717856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1104/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:15.755615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec81b-f6ed-4f26-8f9b-69309fd6a102 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:15.774872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:15.776519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:15.777039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:15.778024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] PATH_INFO: `/v3/projects/c6b3d00c34314d4299cc4dd6b8e8fa09` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:15.779809 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b3d00c34314d4299cc4dd6b8e8fa09)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:15.785966 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:15.890208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:15.894183 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:15.973514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe12e99-b88f-423f-a5f8-47c446e9e37a service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:15.992001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:15.992897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:15.993204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:15.993465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] PATH_INFO: `/v3/projects/0e6fc4f718504a3581f0246f5d93604a` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:15.994845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6fc4f718504a3581f0246f5d93604a)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:15.996911 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:16.211485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b3d00c34314d4299cc4dd6b8e8fa09', 'request_id': 'req-617d73dc-63a3-49d8-a131-e5e7055c9eba'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.222835 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b3d00c34314d4299cc4dd6b8e8fa09', 'request_id': 'req-617d73dc-63a3-49d8-a131-e5e7055c9eba'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.409857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b3d00c34314d4299cc4dd6b8e8fa09', 'request_id': 'req-617d73dc-63a3-49d8-a131-e5e7055c9eba'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.436058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] The token cache is being invalidate because project c6b3d00c34314d4299cc4dd6b8e8fa09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:16.436645 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.438454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6fc4f718504a3581f0246f5d93604a', 'request_id': 'req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.441276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-617d73dc-63a3-49d8-a131-e5e7055c9eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.443781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1083/2187] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:15 2022] DELETE /identity/v3/projects/c6b3d00c34314d4299cc4dd6b8e8fa09 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:16.445417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08022ea-47ec-4630-ad9d-e53629e86546 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:16.446701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08022ea-47ec-4630-ad9d-e53629e86546 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:16.447162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08022ea-47ec-4630-ad9d-e53629e86546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:16.458776 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6fc4f718504a3581f0246f5d93604a', 'request_id': 'req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.477752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6fc4f718504a3581f0246f5d93604a', 'request_id': 'req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.536503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d08022ea-47ec-4630-ad9d-e53629e86546 None None] MFA Rules not processed for user `dd07859f7aba4b908b2779af70a5f5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:16.538797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d08022ea-47ec-4630-ad9d-e53629e86546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:16.586681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] The token cache is being invalidate because project 0e6fc4f718504a3581f0246f5d93604a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:16.586681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.586681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9f4f7ab9-e1f3-42a4-bee1-1730e55ffc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:16.591151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1105/2188] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:15 2022] DELETE /identity/v3/projects/0e6fc4f718504a3581f0246f5d93604a => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:16.600467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8b8d-764b-41f5-9d92-15ce3de3659c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:16.601067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8b8d-764b-41f5-9d92-15ce3de3659c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:16.601529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f8b8d-764b-41f5-9d92-15ce3de3659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:16.647193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a96f8b8d-764b-41f5-9d92-15ce3de3659c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:16.649156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a96f8b8d-764b-41f5-9d92-15ce3de3659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:16.727209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1084/2189] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:16.729216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08022ea-47ec-4630-ad9d-e53629e86546 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:16.741351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d08022ea-47ec-4630-ad9d-e53629e86546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:16.817379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1106/2190] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:16.824846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f8b8d-764b-41f5-9d92-15ce3de3659c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:16.827961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a96f8b8d-764b-41f5-9d92-15ce3de3659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:16.977426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08022ea-47ec-4630-ad9d-e53629e86546 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:16.981180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:16.981180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:16.981993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:16.983401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] PATH_INFO: `/v3/users/f56267b56f414ce384846132b1bb5d50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:16.986009 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56267b56f414ce384846132b1bb5d50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:16.991964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:17.010992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f8b8d-764b-41f5-9d92-15ce3de3659c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:17.023750 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:17.024621 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:17.028188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:17.028720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:17.041138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:17.043120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:17.060573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1107/2191] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:17.061706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:17.067432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:17.094420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc34157-2d26-4b44-857d-1f495a9df54a service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:17.101448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:17.103189 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:17.103691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:17.109084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] PATH_INFO: `/v3/projects/2acfbc669ce74c5cbf4fb0636672269d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:17.109084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2acfbc669ce74c5cbf4fb0636672269d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:17.109084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:17.401817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56267b56f414ce384846132b1bb5d50'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.403023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56267b56f414ce384846132b1bb5d50'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.407660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2acfbc669ce74c5cbf4fb0636672269d', 'request_id': 'req-113da651-e233-49af-9b9b-54867de18ef0'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.416208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2acfbc669ce74c5cbf4fb0636672269d', 'request_id': 'req-113da651-e233-49af-9b9b-54867de18ef0'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.420357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56267b56f414ce384846132b1bb5d50'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.431919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56267b56f414ce384846132b1bb5d50'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.432114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2acfbc669ce74c5cbf4fb0636672269d', 'request_id': 'req-113da651-e233-49af-9b9b-54867de18ef0'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.593377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7245af8d-9547-42e2-9900-661a9de8eaab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56267b56f414ce384846132b1bb5d50'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.614550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1085/2192] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:16 2022] DELETE /identity/v3/users/f56267b56f414ce384846132b1bb5d50 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:17.616068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2664a-0347-4aa8-8241-ac0a4f29515f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:17.616587 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2664a-0347-4aa8-8241-ac0a4f29515f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:17.616939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2664a-0347-4aa8-8241-ac0a4f29515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:17.635995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:17.640012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-efb2664a-0347-4aa8-8241-ac0a4f29515f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:17.640836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-efb2664a-0347-4aa8-8241-ac0a4f29515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:17.690383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] The token cache is being invalidate because project 2acfbc669ce74c5cbf4fb0636672269d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:17.692020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.698482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:17.707921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1108/2193] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:17 2022] DELETE /identity/v3/projects/2acfbc669ce74c5cbf4fb0636672269d => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:17.709815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:17.719651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:17.733763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1086/2194] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:17.739622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2664a-0347-4aa8-8241-ac0a4f29515f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:17.752548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2664a-0347-4aa8-8241-ac0a4f29515f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:17.760142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:17.761418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:17.761937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:17.768330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:17.768330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:17.768330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:17.773319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:17.829149 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1087/2195] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:02:17.831618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:17.853545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757d411-f2e7-4ee9-9eed-a531899f9c8e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:17.871925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d4ef-b81c-4ee4-832e-1db257539002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:17.871925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d4ef-b81c-4ee4-832e-1db257539002 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:17.871925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d4ef-b81c-4ee4-832e-1db257539002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:17.873853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d4ef-b81c-4ee4-832e-1db257539002 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:17.875352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8d4ef-b81c-4ee4-832e-1db257539002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:17.882453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8d4ef-b81c-4ee4-832e-1db257539002 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:17.922354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113da651-e233-49af-9b9b-54867de18ef0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:17.928183 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:17.929120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:17.929545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:17.929922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] PATH_INFO: `/v3/users/1b8602b7b491422fa283f2532743bc48` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:17.931634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8602b7b491422fa283f2532743bc48)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:17.933803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:18.053100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:18.079293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1088/2196] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:17 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:18.081219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d4ef-b81c-4ee4-832e-1db257539002 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:18.194796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d4ef-b81c-4ee4-832e-1db257539002 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:18.200630 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:18.207893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:18.207893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:18.207893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:18.207893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:18.207893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:18.257022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8602b7b491422fa283f2532743bc48'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.258134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8602b7b491422fa283f2532743bc48'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.259363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8602b7b491422fa283f2532743bc48'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.330092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1089/2197] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:18 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:18.331424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:18.339140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:18.359369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec7fd3-adb5-4ef4-b63b-3e917fbd26c7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:18.359556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8602b7b491422fa283f2532743bc48'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.369463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:18.372838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:18.373424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:18.374185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] PATH_INFO: `/v3/projects/a81fd4f638f7444e9f1034a4aa27d739` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:18.378097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81fd4f638f7444e9f1034a4aa27d739)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:18.382364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:18.424966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8602b7b491422fa283f2532743bc48'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.470449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1109/2198] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:17 2022] DELETE /identity/v3/users/1b8602b7b491422fa283f2532743bc48 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:18.472631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:18.486852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:18.583232 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81fd4f638f7444e9f1034a4aa27d739', 'request_id': 'req-8a3918c7-d97d-4ac8-a966-52e2a218809d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.589793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab003d-6cb8-4b0b-9697-425594ae917b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:18.609923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81fd4f638f7444e9f1034a4aa27d739', 'request_id': 'req-8a3918c7-d97d-4ac8-a966-52e2a218809d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.708162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:18.709178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:18.709554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:18.710548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:18.712016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:18.712985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81fd4f638f7444e9f1034a4aa27d739', 'request_id': 'req-8a3918c7-d97d-4ac8-a966-52e2a218809d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.715056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:18.729967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] The token cache is being invalidate because project a81fd4f638f7444e9f1034a4aa27d739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:18.730783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.739729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8a3918c7-d97d-4ac8-a966-52e2a218809d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:18.745511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1090/2199] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:18 2022] DELETE /identity/v3/projects/a81fd4f638f7444e9f1034a4aa27d739 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:18.761477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087f6d6-9b9c-40ad-b643-3e6b1a158aaa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:18.761974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087f6d6-9b9c-40ad-b643-3e6b1a158aaa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:18.764711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087f6d6-9b9c-40ad-b643-3e6b1a158aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:18.778587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1110/2200] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:18.781902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:18.785449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:18.837071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b68302-9a67-4c35-b0c7-210495d5f9db admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:18.848984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b087f6d6-9b9c-40ad-b643-3e6b1a158aaa None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:18.851100 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b087f6d6-9b9c-40ad-b643-3e6b1a158aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:18.857444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40568f-9717-4fbc-8a9f-311b1d99e4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:18.858901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40568f-9717-4fbc-8a9f-311b1d99e4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:18.859385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40568f-9717-4fbc-8a9f-311b1d99e4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:18.859883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40568f-9717-4fbc-8a9f-311b1d99e4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:18.861309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40568f-9717-4fbc-8a9f-311b1d99e4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:18.864347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40568f-9717-4fbc-8a9f-311b1d99e4f7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:18.878524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1091/2201] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:18.887428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e50d-aada-4a8e-bc8e-4fab704f3deb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:18.887880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e50d-aada-4a8e-bc8e-4fab704f3deb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:18.888222 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1111/2202] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:02:18.888524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e50d-aada-4a8e-bc8e-4fab704f3deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:18.897152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40568f-9717-4fbc-8a9f-311b1d99e4f7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:18.917649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-96a4e50d-aada-4a8e-bc8e-4fab704f3deb None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:18.919101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-96a4e50d-aada-4a8e-bc8e-4fab704f3deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:18.929024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1092/2203] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:02:18.935349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4e50d-aada-4a8e-bc8e-4fab704f3deb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:18.942885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40568f-9717-4fbc-8a9f-311b1d99e4f7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:18.950960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4e50d-aada-4a8e-bc8e-4fab704f3deb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:18.956871 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:18.957617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:18.958204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:18.958498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:18.959523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:18.959857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:18.961577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:18.966680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365ff91-f151-4e6c-9563-d39cc6f33366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:18.968655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ff91-f151-4e6c-9563-d39cc6f33366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:18.969379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ff91-f151-4e6c-9563-d39cc6f33366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:18.970126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ff91-f151-4e6c-9563-d39cc6f33366 admin admin] PATH_INFO: `/v3/projects/88cc58068dc749479b723b40a455c8c3/users/9e9848da15ea4ddfbceaf556423ba852/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:18.976765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1093/2204] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:02:18.981762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:19.021449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717209b-20ae-47f3-aa14-97d9e933abd5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:19.031185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ad3d-c477-4742-98c2-6972ae1354e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:19.031185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ad3d-c477-4742-98c2-6972ae1354e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:19.031185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ad3d-c477-4742-98c2-6972ae1354e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:19.031185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2ad3d-c477-4742-98c2-6972ae1354e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:19.039852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2ad3d-c477-4742-98c2-6972ae1354e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:19.039852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2ad3d-c477-4742-98c2-6972ae1354e1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:19.040372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365ff91-f151-4e6c-9563-d39cc6f33366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cc58068dc749479b723b40a455c8c3, user_id=9e9848da15ea4ddfbceaf556423ba852, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:19.050370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365ff91-f151-4e6c-9563-d39cc6f33366 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:19.218584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1094/2205] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:18 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:19.224241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ad3d-c477-4742-98c2-6972ae1354e1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:19.224440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1112/2206] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:18 2022] PUT /identity/v3/projects/88cc58068dc749479b723b40a455c8c3/users/9e9848da15ea4ddfbceaf556423ba852/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:19.226372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11272e-a1b7-47c6-a10c-799ef09f7248 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:19.228195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11272e-a1b7-47c6-a10c-799ef09f7248 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:19.228495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11272e-a1b7-47c6-a10c-799ef09f7248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:19.269011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2b11272e-a1b7-47c6-a10c-799ef09f7248 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:19.269231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2b11272e-a1b7-47c6-a10c-799ef09f7248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:19.363602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1113/2207] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:19.383993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2ad3d-c477-4742-98c2-6972ae1354e1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:19.391800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11272e-a1b7-47c6-a10c-799ef09f7248 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:19.393814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2b11272e-a1b7-47c6-a10c-799ef09f7248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:19.395897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628e081-6be4-44e2-b1e8-2f10a76552c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:19.396884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628e081-6be4-44e2-b1e8-2f10a76552c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:19.397262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628e081-6be4-44e2-b1e8-2f10a76552c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:19.397640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628e081-6be4-44e2-b1e8-2f10a76552c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:19.398675 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628e081-6be4-44e2-b1e8-2f10a76552c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:19.401089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628e081-6be4-44e2-b1e8-2f10a76552c8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:19.538663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11272e-a1b7-47c6-a10c-799ef09f7248 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:19.546646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a382-7d9a-4e46-ab18-338fb3d88506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:19.548102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a382-7d9a-4e46-ab18-338fb3d88506 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:19.549347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a382-7d9a-4e46-ab18-338fb3d88506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:19.549921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a382-7d9a-4e46-ab18-338fb3d88506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:19.570498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a382-7d9a-4e46-ab18-338fb3d88506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:19.574038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a382-7d9a-4e46-ab18-338fb3d88506 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:19.598540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1114/2208] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:19.650341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1095/2209] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:19 2022] POST /identity/v3/users => generated 293 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:19.657536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a382-7d9a-4e46-ab18-338fb3d88506 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:19.672151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a382-7d9a-4e46-ab18-338fb3d88506 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:19.683664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:19.684837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:19.685259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:19.685557 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:19.686341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:19.688137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:19.704536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1115/2210] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:19.710471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628e081-6be4-44e2-b1e8-2f10a76552c8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:19.723772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:19.731587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:19.754385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67e167-11cc-4d12-916b-3e01909547aa admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:19.755701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628e081-6be4-44e2-b1e8-2f10a76552c8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:19.773515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5d12-a784-49e3-8073-2d827bcfd8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:19.773515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5d12-a784-49e3-8073-2d827bcfd8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:19.773515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5d12-a784-49e3-8073-2d827bcfd8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:19.773515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5d12-a784-49e3-8073-2d827bcfd8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:19.774755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5d12-a784-49e3-8073-2d827bcfd8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:19.774755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5d12-a784-49e3-8073-2d827bcfd8f0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:19.775267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:19.776139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:19.776646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:19.777404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] PATH_INFO: `/v3/projects/9217692d7d8b40c2847ca5997ae45ba4` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:19.780856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9217692d7d8b40c2847ca5997ae45ba4)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:19.785781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:19.787913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1096/2211] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:19.792612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5d12-a784-49e3-8073-2d827bcfd8f0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:19.812807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5d12-a784-49e3-8073-2d827bcfd8f0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:19.820770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8743ce-19c8-4dd8-846d-fbaa014f4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:19.823224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8743ce-19c8-4dd8-846d-fbaa014f4708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:19.823793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8743ce-19c8-4dd8-846d-fbaa014f4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:19.824365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8743ce-19c8-4dd8-846d-fbaa014f4708 admin admin] PATH_INFO: `/v3/projects/ae9e6666e1b84c81a6e6c3a758f95239/users/31e9285f9a154ba9b649c3ff9274e556/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:19.851035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8743ce-19c8-4dd8-846d-fbaa014f4708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9e6666e1b84c81a6e6c3a758f95239, user_id=31e9285f9a154ba9b649c3ff9274e556, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:19.855256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8743ce-19c8-4dd8-846d-fbaa014f4708 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:20.014361 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1097/2212] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:19 2022] PUT /identity/v3/projects/ae9e6666e1b84c81a6e6c3a758f95239/users/31e9285f9a154ba9b649c3ff9274e556/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:20.021479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213ba66-e3e1-4361-b803-767d17997098 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:20.022482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213ba66-e3e1-4361-b803-767d17997098 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:20.022769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213ba66-e3e1-4361-b803-767d17997098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:20.023784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9217692d7d8b40c2847ca5997ae45ba4', 'request_id': 'req-5996df43-440e-469f-aa26-e0f25b7393f9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:20.047527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9217692d7d8b40c2847ca5997ae45ba4', 'request_id': 'req-5996df43-440e-469f-aa26-e0f25b7393f9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:20.076286 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9217692d7d8b40c2847ca5997ae45ba4', 'request_id': 'req-5996df43-440e-469f-aa26-e0f25b7393f9'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:20.084646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0213ba66-e3e1-4361-b803-767d17997098 None None] MFA Rules not processed for user `31e9285f9a154ba9b649c3ff9274e556`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:20.085946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0213ba66-e3e1-4361-b803-767d17997098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:20.194226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] The token cache is being invalidate because project 9217692d7d8b40c2847ca5997ae45ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:20.195830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:20.201834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5996df43-440e-469f-aa26-e0f25b7393f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:20.235435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1116/2213] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:19 2022] DELETE /identity/v3/projects/9217692d7d8b40c2847ca5997ae45ba4 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:20.241069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e300af-e07f-4eba-8dd4-f0d9d344f854 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:20.247881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e300af-e07f-4eba-8dd4-f0d9d344f854 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:20.248611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e300af-e07f-4eba-8dd4-f0d9d344f854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:20.380137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d2e300af-e07f-4eba-8dd4-f0d9d344f854 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:20.382399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d2e300af-e07f-4eba-8dd4-f0d9d344f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:20.391490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1098/2214] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:20.404649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213ba66-e3e1-4361-b803-767d17997098 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:20.406132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0213ba66-e3e1-4361-b803-767d17997098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:20.569074 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213ba66-e3e1-4361-b803-767d17997098 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:20.569194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1117/2215] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:20.569194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e300af-e07f-4eba-8dd4-f0d9d344f854 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:20.571813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad59ad-0f40-4373-93ee-df0a41edfba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:20.572975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad59ad-0f40-4373-93ee-df0a41edfba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:20.573380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad59ad-0f40-4373-93ee-df0a41edfba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:20.573761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad59ad-0f40-4373-93ee-df0a41edfba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:20.574746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d2e300af-e07f-4eba-8dd4-f0d9d344f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:20.601574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e300af-e07f-4eba-8dd4-f0d9d344f854 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:20.609771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad59ad-0f40-4373-93ee-df0a41edfba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:20.611625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:20.611979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad59ad-0f40-4373-93ee-df0a41edfba7 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:20.612652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:20.613129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:20.613617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] PATH_INFO: `/v3/users/daf85b9a1bf642cb8bbc157aebba532f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:20.617563 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf85b9a1bf642cb8bbc157aebba532f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:20.623048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:20.635987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1099/2216] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:20.639466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd02c-fdcb-408c-b2da-363c76ced942 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:20.643256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd02c-fdcb-408c-b2da-363c76ced942 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:20.644046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cd02c-fdcb-408c-b2da-363c76ced942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:20.688148 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e53cd02c-fdcb-408c-b2da-363c76ced942 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:20.690622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e53cd02c-fdcb-408c-b2da-363c76ced942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:20.725853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1100/2217] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:20.727002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cd02c-fdcb-408c-b2da-363c76ced942 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:20.729919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e53cd02c-fdcb-408c-b2da-363c76ced942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:20.764647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cd02c-fdcb-408c-b2da-363c76ced942 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:20.780603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:20.784831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:20.784831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:20.784831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] PATH_INFO: `/v3/users/31e9285f9a154ba9b649c3ff9274e556` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:20.799508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e9285f9a154ba9b649c3ff9274e556)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:20.799508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:20.933263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf85b9a1bf642cb8bbc157aebba532f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:20.934792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf85b9a1bf642cb8bbc157aebba532f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:20.935988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf85b9a1bf642cb8bbc157aebba532f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:21.107731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf85b9a1bf642cb8bbc157aebba532f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:21.131057 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf85b9a1bf642cb8bbc157aebba532f'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:21.146794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1118/2218] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:20 2022] DELETE /identity/v3/users/daf85b9a1bf642cb8bbc157aebba532f => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:21.148149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:21.150001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:21.200514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e9285f9a154ba9b649c3ff9274e556'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:21.201525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e9285f9a154ba9b649c3ff9274e556'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:21.212093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e9285f9a154ba9b649c3ff9274e556'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:21.213168 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e9285f9a154ba9b649c3ff9274e556'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:21.260581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0749-ffb8-48f5-8aba-a508dcbbeb57 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:21.265780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec05524-7849-41ac-beb3-460a45f72ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:21.266518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05524-7849-41ac-beb3-460a45f72ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:21.266930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05524-7849-41ac-beb3-460a45f72ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:21.267398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec05524-7849-41ac-beb3-460a45f72ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:21.268422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05524-7849-41ac-beb3-460a45f72ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:21.268742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05524-7849-41ac-beb3-460a45f72ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:21.270391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec05524-7849-41ac-beb3-460a45f72ca8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:21.291305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1119/2219] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:02:21.293179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88568c7-5a2b-44f0-b21c-f1e8392cf358 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:21.293778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88568c7-5a2b-44f0-b21c-f1e8392cf358 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:21.299391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88568c7-5a2b-44f0-b21c-f1e8392cf358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:21.325603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a88568c7-5a2b-44f0-b21c-f1e8392cf358 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:21.328462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a88568c7-5a2b-44f0-b21c-f1e8392cf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:21.347126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1120/2220] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:21.349561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65811-94a6-4e81-99ef-234d8e8200bc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:21.350089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65811-94a6-4e81-99ef-234d8e8200bc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:21.350666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef65811-94a6-4e81-99ef-234d8e8200bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:21.369912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e9285f9a154ba9b649c3ff9274e556'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:21.405221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1101/2221] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:20 2022] DELETE /identity/v3/users/31e9285f9a154ba9b649c3ff9274e556 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:21.409932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:21.409932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:21.424329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0ef65811-94a6-4e81-99ef-234d8e8200bc None None] MFA Rules not processed for user `dd07859f7aba4b908b2779af70a5f5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:21.427467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0ef65811-94a6-4e81-99ef-234d8e8200bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:21.504907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1739-f3cd-4a33-aef2-d28034529926 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:21.510050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356174bd-d14b-4765-b935-10b6c1418a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:21.510926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356174bd-d14b-4765-b935-10b6c1418a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:21.511225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356174bd-d14b-4765-b935-10b6c1418a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:21.511520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356174bd-d14b-4765-b935-10b6c1418a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:21.512236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356174bd-d14b-4765-b935-10b6c1418a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:21.514281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1121/2222] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:21.514435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356174bd-d14b-4765-b935-10b6c1418a66 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:21.514993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef65811-94a6-4e81-99ef-234d8e8200bc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:21.520428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0ef65811-94a6-4e81-99ef-234d8e8200bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:21.601846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef65811-94a6-4e81-99ef-234d8e8200bc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:21.606187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646800d5-9176-460c-a5d3-491f8416f764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:21.606952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646800d5-9176-460c-a5d3-491f8416f764 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:21.607308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646800d5-9176-460c-a5d3-491f8416f764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:21.607937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646800d5-9176-460c-a5d3-491f8416f764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:21.621373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646800d5-9176-460c-a5d3-491f8416f764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:21.625199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646800d5-9176-460c-a5d3-491f8416f764 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:21.662326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1122/2223] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:21.664785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287bdff-5930-439c-9afd-f142b723f921 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:21.665228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287bdff-5930-439c-9afd-f142b723f921 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:21.665517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287bdff-5930-439c-9afd-f142b723f921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:21.686304 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:21.698763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1102/2224] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:21 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:21.704623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356174bd-d14b-4765-b935-10b6c1418a66 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:21.716321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8287bdff-5930-439c-9afd-f142b723f921 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:21.717583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8287bdff-5930-439c-9afd-f142b723f921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:21.852781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:21.928628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356174bd-d14b-4765-b935-10b6c1418a66 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:21.940132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1123/2225] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:21.942355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840d4ef-3eac-44fc-96ed-aedf38bd3dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:22.004421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d4ef-3eac-44fc-96ed-aedf38bd3dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:22.004421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d4ef-3eac-44fc-96ed-aedf38bd3dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:22.004421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840d4ef-3eac-44fc-96ed-aedf38bd3dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:22.004421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840d4ef-3eac-44fc-96ed-aedf38bd3dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:22.004421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840d4ef-3eac-44fc-96ed-aedf38bd3dd7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:22.013956 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287bdff-5930-439c-9afd-f142b723f921 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:22.016811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8287bdff-5930-439c-9afd-f142b723f921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:22.172653 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287bdff-5930-439c-9afd-f142b723f921 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:22.180561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999945a-5154-49bc-9a5c-a2c04120ff30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:22.183733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999945a-5154-49bc-9a5c-a2c04120ff30 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:22.184353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999945a-5154-49bc-9a5c-a2c04120ff30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:22.184825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999945a-5154-49bc-9a5c-a2c04120ff30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:22.216599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999945a-5154-49bc-9a5c-a2c04120ff30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:22.219486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999945a-5154-49bc-9a5c-a2c04120ff30 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:22.258392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1124/2226] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:02:22.283191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1103/2227] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:21 2022] POST /identity/v3/users => generated 289 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:22.287310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999945a-5154-49bc-9a5c-a2c04120ff30 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:22.299802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999945a-5154-49bc-9a5c-a2c04120ff30 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:22.310327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d6634-e09e-4eb0-a444-c312cb6a3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:22.311970 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6634-e09e-4eb0-a444-c312cb6a3897 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:22.312752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6634-e09e-4eb0-a444-c312cb6a3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:22.313522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d6634-e09e-4eb0-a444-c312cb6a3897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:22.316041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d6634-e09e-4eb0-a444-c312cb6a3897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:22.322479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d6634-e09e-4eb0-a444-c312cb6a3897 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:22.355481 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1125/2228] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:22.363514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840d4ef-3eac-44fc-96ed-aedf38bd3dd7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:22.398884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840d4ef-3eac-44fc-96ed-aedf38bd3dd7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:22.413740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9895b3f-04a5-48ad-8d96-f83364ddb4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:22.415131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9895b3f-04a5-48ad-8d96-f83364ddb4dc admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:22.418486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9895b3f-04a5-48ad-8d96-f83364ddb4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:22.423704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9895b3f-04a5-48ad-8d96-f83364ddb4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:22.423704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9895b3f-04a5-48ad-8d96-f83364ddb4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:22.430799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9895b3f-04a5-48ad-8d96-f83364ddb4dc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:22.528950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d6634-e09e-4eb0-a444-c312cb6a3897 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:22.541136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1104/2229] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:02:22.549995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d6634-e09e-4eb0-a444-c312cb6a3897 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:22.570905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:22.578295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:22.578295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:22.578295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] PATH_INFO: `/v3/projects/f8fc6785f4fb47479e55b4c5872caf4c/users/4d77733154224b52ba9a8d573e99bf24/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:22.671966 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8fc6785f4fb47479e55b4c5872caf4c, user_id=4d77733154224b52ba9a8d573e99bf24, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:22.681240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:22.851449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1126/2230] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:22 2022] PUT /identity/v3/projects/f8fc6785f4fb47479e55b4c5872caf4c/users/4d77733154224b52ba9a8d573e99bf24/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:22.865223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79326b-775a-4add-91bb-40555ee71563 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:22.866178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79326b-775a-4add-91bb-40555ee71563 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:22.866714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79326b-775a-4add-91bb-40555ee71563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:22.908595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ed79326b-775a-4add-91bb-40555ee71563 None None] MFA Rules not processed for user `4d77733154224b52ba9a8d573e99bf24`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:22.910673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ed79326b-775a-4add-91bb-40555ee71563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:22.998595 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:23.000967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:23.147097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1105/2231] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:23.151373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79326b-775a-4add-91bb-40555ee71563 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:23.234376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f393f0e-04a7-49d7-aef9-5e3724c8216f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:23.245316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:23.246271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:23.246565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:23.248462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] PATH_INFO: `/v3/projects/43e4a60890a64882b30827e25894da63` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:23.252802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e4a60890a64882b30827e25894da63)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:23.261965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:23.310478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79326b-775a-4add-91bb-40555ee71563 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:23.315919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:23.316635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:23.316923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:23.317201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:23.317916 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:23.320988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:23.364441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:23.505191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e4a60890a64882b30827e25894da63', 'request_id': 'req-50cba7e0-019a-443f-808b-a3cf7320379b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:23.520906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e4a60890a64882b30827e25894da63', 'request_id': 'req-50cba7e0-019a-443f-808b-a3cf7320379b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:23.529587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e4a60890a64882b30827e25894da63', 'request_id': 'req-50cba7e0-019a-443f-808b-a3cf7320379b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:23.580858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1106/2232] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:23 2022] POST /identity/v3/projects => generated 375 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:23.580858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:23.585058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:23.680366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efb1e5-9bf3-4542-bc66-73f873993087 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:23.685672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:23.686719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:23.687187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:23.687845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] PATH_INFO: `/v3/projects/ae9e6666e1b84c81a6e6c3a758f95239` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:23.690126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9e6666e1b84c81a6e6c3a758f95239)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:23.692218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:23.725386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] The token cache is being invalidate because project 43e4a60890a64882b30827e25894da63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:23.726301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:23.731617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:23.745948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1127/2233] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:22 2022] DELETE /identity/v3/projects/43e4a60890a64882b30827e25894da63 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:23.750898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:23.761569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:23.901943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cba7e0-019a-443f-808b-a3cf7320379b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:23.910239 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:23.911007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:23.911294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:23.911575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:23.912316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:23.914356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:24.030261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9e6666e1b84c81a6e6c3a758f95239', 'request_id': 'req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.038475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9e6666e1b84c81a6e6c3a758f95239', 'request_id': 'req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.057195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1128/2234] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:23 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:24.058962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:24.061526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:24.079386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeff13-7041-428c-9b99-db1b7b59b1f1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:24.169158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9e6666e1b84c81a6e6c3a758f95239', 'request_id': 'req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.175553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:24.176935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.177444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.177738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] PATH_INFO: `/v3/users/bebaaffa636d4804991b8af72254ddbf` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:24.180066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bebaaffa636d4804991b8af72254ddbf)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:24.183411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:24.191793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] The token cache is being invalidate because project ae9e6666e1b84c81a6e6c3a758f95239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:24.192126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.194511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.200758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1107/2235] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:23 2022] DELETE /identity/v3/projects/ae9e6666e1b84c81a6e6c3a758f95239 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:24.200758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:24.203593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:24.224507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d879f0f-95e2-4edf-80a8-86f1f748e8b8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:24.230543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c466f1-b20d-4eca-b2ad-80d7e0801d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:24.231353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c466f1-b20d-4eca-b2ad-80d7e0801d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.231735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c466f1-b20d-4eca-b2ad-80d7e0801d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.232086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c466f1-b20d-4eca-b2ad-80d7e0801d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:24.233193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c466f1-b20d-4eca-b2ad-80d7e0801d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:24.235006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c466f1-b20d-4eca-b2ad-80d7e0801d19 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:24.250766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1108/2236] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:24.255096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349e40-1001-4a6b-8e0d-3fcd13c3f0b0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.255449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349e40-1001-4a6b-8e0d-3fcd13c3f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.255844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b349e40-1001-4a6b-8e0d-3fcd13c3f0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:24.280410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0b349e40-1001-4a6b-8e0d-3fcd13c3f0b0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:24.282236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0b349e40-1001-4a6b-8e0d-3fcd13c3f0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:24.292743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1109/2237] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:24.294124 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349e40-1001-4a6b-8e0d-3fcd13c3f0b0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:24.316283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b349e40-1001-4a6b-8e0d-3fcd13c3f0b0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:24.336715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a212022-072d-45ed-a73e-4df377f8ab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:24.338118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a212022-072d-45ed-a73e-4df377f8ab3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.338485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a212022-072d-45ed-a73e-4df377f8ab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.338840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a212022-072d-45ed-a73e-4df377f8ab3f admin admin] PATH_INFO: `/v3/projects/ad3e6d72293f494682ca1d532740113f/users/a005228cc45c40eaad34dd946211dd27/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:24.360631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a212022-072d-45ed-a73e-4df377f8ab3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3e6d72293f494682ca1d532740113f, user_id=a005228cc45c40eaad34dd946211dd27, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:24.365954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a212022-072d-45ed-a73e-4df377f8ab3f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:24.595612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1110/2238] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:24 2022] PUT /identity/v3/projects/ad3e6d72293f494682ca1d532740113f/users/a005228cc45c40eaad34dd946211dd27/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:24.608224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21f1b-db6a-42f9-bcd2-c7076a2c55ba None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.608401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21f1b-db6a-42f9-bcd2-c7076a2c55ba None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.609479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bebaaffa636d4804991b8af72254ddbf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.610385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bebaaffa636d4804991b8af72254ddbf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.611049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a21f1b-db6a-42f9-bcd2-c7076a2c55ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:24.612633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bebaaffa636d4804991b8af72254ddbf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.656493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-04a21f1b-db6a-42f9-bcd2-c7076a2c55ba None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:24.661900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-04a21f1b-db6a-42f9-bcd2-c7076a2c55ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:24.752662 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1111/2239] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:24.753107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a21f1b-db6a-42f9-bcd2-c7076a2c55ba None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:24.755399 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-04a21f1b-db6a-42f9-bcd2-c7076a2c55ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:24.770296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a21f1b-db6a-42f9-bcd2-c7076a2c55ba None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:24.780890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4756a-5c5e-40cf-ae30-bacfaa3843cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:24.780890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4756a-5c5e-40cf-ae30-bacfaa3843cf admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.780890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4756a-5c5e-40cf-ae30-bacfaa3843cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.780890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4756a-5c5e-40cf-ae30-bacfaa3843cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:24.781245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4756a-5c5e-40cf-ae30-bacfaa3843cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:24.783553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4756a-5c5e-40cf-ae30-bacfaa3843cf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:24.799648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1112/2240] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:24.800799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4756a-5c5e-40cf-ae30-bacfaa3843cf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:24.814456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4756a-5c5e-40cf-ae30-bacfaa3843cf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:24.821494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:24.822473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.822964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.823426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:24.824428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:24.824926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:24.829723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:24.844641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1113/2241] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:02:24.851364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:24.865179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5889-1956-47ee-a08a-76a5d95f28b1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:24.870951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624560c-b939-43ad-87ce-1bcac7aa8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:24.871906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624560c-b939-43ad-87ce-1bcac7aa8e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.872143 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624560c-b939-43ad-87ce-1bcac7aa8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.872424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624560c-b939-43ad-87ce-1bcac7aa8e07 admin admin] PATH_INFO: `/v3/projects/ad3e6d72293f494682ca1d532740113f/users/a005228cc45c40eaad34dd946211dd27/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:24.875350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624560c-b939-43ad-87ce-1bcac7aa8e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3e6d72293f494682ca1d532740113f, user_id=a005228cc45c40eaad34dd946211dd27, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:24.879076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624560c-b939-43ad-87ce-1bcac7aa8e07 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:24.892052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1114/2242] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:24 2022] PUT /identity/v3/projects/ad3e6d72293f494682ca1d532740113f/users/a005228cc45c40eaad34dd946211dd27/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:24.894086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624560c-b939-43ad-87ce-1bcac7aa8e07 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:24.921634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bebaaffa636d4804991b8af72254ddbf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.964008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-457ce7d2-f9d0-4210-a088-6e3675e4c95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bebaaffa636d4804991b8af72254ddbf'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:24.990850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1129/2243] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:24 2022] DELETE /identity/v3/users/bebaaffa636d4804991b8af72254ddbf => generated 0 bytes in 933 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:24.994477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd241bb-6b1a-4ab3-8712-f3396c794461 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:24.994671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd241bb-6b1a-4ab3-8712-f3396c794461 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:24.995128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd241bb-6b1a-4ab3-8712-f3396c794461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:25.043509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624560c-b939-43ad-87ce-1bcac7aa8e07 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:25.088563 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2dd241bb-6b1a-4ab3-8712-f3396c794461 None None] MFA Rules not processed for user `a005228cc45c40eaad34dd946211dd27`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:25.091662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2dd241bb-6b1a-4ab3-8712-f3396c794461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:25.170301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f14f5-6c1e-4c28-9e61-61b0d0ad0767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:25.172169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f14f5-6c1e-4c28-9e61-61b0d0ad0767 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:25.172456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f14f5-6c1e-4c28-9e61-61b0d0ad0767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:25.172732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f14f5-6c1e-4c28-9e61-61b0d0ad0767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:25.173621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f14f5-6c1e-4c28-9e61-61b0d0ad0767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:25.175651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f14f5-6c1e-4c28-9e61-61b0d0ad0767 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:25.247448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1130/2244] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:25.253865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd241bb-6b1a-4ab3-8712-f3396c794461 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:25.255745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2dd241bb-6b1a-4ab3-8712-f3396c794461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:25.352521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd241bb-6b1a-4ab3-8712-f3396c794461 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:25.370116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1115/2245] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:24 2022] POST /identity/v3/projects => generated 375 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:25.371738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f14f5-6c1e-4c28-9e61-61b0d0ad0767 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:25.378832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:25.379487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:25.379836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:25.380242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:25.382695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:25.508664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f14f5-6c1e-4c28-9e61-61b0d0ad0767 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:25.518736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a96d1-5f7d-4c10-84f6-3b966d143217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:25.522355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a96d1-5f7d-4c10-84f6-3b966d143217 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:25.523638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a96d1-5f7d-4c10-84f6-3b966d143217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:25.524280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a96d1-5f7d-4c10-84f6-3b966d143217 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:25.525821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a96d1-5f7d-4c10-84f6-3b966d143217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:25.528859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a96d1-5f7d-4c10-84f6-3b966d143217 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:25.545737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:25.547450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:25.575978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1131/2246] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:25.799350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1116/2247] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:25 2022] POST /identity/v3/users => generated 288 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:25.804674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:25.834089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a45fda-6679-436f-926f-0b6596408cfd service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:25.858132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a141-3f95-4e04-9527-ef1f3ddf0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:25.858132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a141-3f95-4e04-9527-ef1f3ddf0a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:25.858132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a141-3f95-4e04-9527-ef1f3ddf0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:25.858132 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17a141-3f95-4e04-9527-ef1f3ddf0a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:25.858905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17a141-3f95-4e04-9527-ef1f3ddf0a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:25.859298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17a141-3f95-4e04-9527-ef1f3ddf0a05 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:25.886275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1132/2248] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:25.894002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a96d1-5f7d-4c10-84f6-3b966d143217 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:25.915478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a96d1-5f7d-4c10-84f6-3b966d143217 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:25.929948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:25.930690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:25.930974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:25.931262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:25.932022 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:25.933767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:25.968109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a141-3f95-4e04-9527-ef1f3ddf0a05 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:25.970518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1117/2249] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:25.991874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17a141-3f95-4e04-9527-ef1f3ddf0a05 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:26.007616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f805-ab0d-40d2-8b01-9a415016d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:26.019512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f805-ab0d-40d2-8b01-9a415016d630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:26.019923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f805-ab0d-40d2-8b01-9a415016d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:26.020223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f805-ab0d-40d2-8b01-9a415016d630 admin admin] PATH_INFO: `/v3/projects/0b7585cd2b10479ca6b3926444da1813/users/66dab395a6c6436589af158c08d025ee/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:26.042788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257f805-ab0d-40d2-8b01-9a415016d630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7585cd2b10479ca6b3926444da1813, user_id=66dab395a6c6436589af158c08d025ee, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:26.045787 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257f805-ab0d-40d2-8b01-9a415016d630 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:26.160167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:26.162015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:26.184235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae14dd-6694-45a7-b71a-e219425810d1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:26.199198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1133/2250] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:25 2022] PUT /identity/v3/projects/0b7585cd2b10479ca6b3926444da1813/users/66dab395a6c6436589af158c08d025ee/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:26.214779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267e1cf-60da-4f2b-acf2-b23a5fc17c4c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:26.215120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267e1cf-60da-4f2b-acf2-b23a5fc17c4c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:26.215359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267e1cf-60da-4f2b-acf2-b23a5fc17c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:26.227753 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:26.232553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:26.232855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:26.233140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] PATH_INFO: `/v3/projects/4df87a94e7f149539501875de37f87e3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:26.258833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df87a94e7f149539501875de37f87e3)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:26.258833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:26.293153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8267e1cf-60da-4f2b-acf2-b23a5fc17c4c None None] MFA Rules not processed for user `66dab395a6c6436589af158c08d025ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:26.295939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8267e1cf-60da-4f2b-acf2-b23a5fc17c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:26.468603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df87a94e7f149539501875de37f87e3', 'request_id': 'req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:26.480379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df87a94e7f149539501875de37f87e3', 'request_id': 'req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:26.497736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1134/2251] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:26.511378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267e1cf-60da-4f2b-acf2-b23a5fc17c4c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:26.513003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8267e1cf-60da-4f2b-acf2-b23a5fc17c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:26.609135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267e1cf-60da-4f2b-acf2-b23a5fc17c4c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:26.681849 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0722-ba3c-4fc9-93d8-f97ce8c28329 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb36ac7a2e4643009bc1b0ca599203f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:26.682816 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0722-ba3c-4fc9-93d8-f97ce8c28329 service glance] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:26.683409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0722-ba3c-4fc9-93d8-f97ce8c28329 service glance] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:26.683973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0722-ba3c-4fc9-93d8-f97ce8c28329 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:26.778725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e0722-ba3c-4fc9-93d8-f97ce8c28329 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:26.781328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e0722-ba3c-4fc9-93d8-f97ce8c28329 service glance] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:26.808879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1135/2252] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:02:26.849901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df87a94e7f149539501875de37f87e3', 'request_id': 'req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:26.865550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] The token cache is being invalidate because project 4df87a94e7f149539501875de37f87e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:26.866097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:26.867002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:26.870121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1118/2253] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:26 2022] DELETE /identity/v3/projects/4df87a94e7f149539501875de37f87e3 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:26.873975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0722-ba3c-4fc9-93d8-f97ce8c28329 service glance] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:26.969491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0722-ba3c-4fc9-93d8-f97ce8c28329 service glance] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:26.983437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:26.984801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:26.986620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:26.987103 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:26.987434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] PATH_INFO: `/v3/users/1655fdce5177426fb15244ec72465c1d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:26.989455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1655fdce5177426fb15244ec72465c1d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:26.991646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:27.247696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1655fdce5177426fb15244ec72465c1d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:27.250495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1655fdce5177426fb15244ec72465c1d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:27.265805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1655fdce5177426fb15244ec72465c1d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:27.419302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1655fdce5177426fb15244ec72465c1d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:27.450834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f058f674-6113-4588-8a6a-c80a3dd32579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1655fdce5177426fb15244ec72465c1d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:27.473692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1136/2254] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:26 2022] DELETE /identity/v3/users/1655fdce5177426fb15244ec72465c1d => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:28.388145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=3,keystone:SELECT=79,keystone:DELETE=18 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:28.515059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:28.516708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:28.550701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cff54-3bc4-42a2-a8f1-66fa85b1af8d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:28.740079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:28.741872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:28.742739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:28.743220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] PATH_INFO: `/v3/projects/18e60736ed0b4485b370bd799ce1277e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:28.745384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e60736ed0b4485b370bd799ce1277e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:28.749163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:28.955881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e60736ed0b4485b370bd799ce1277e', 'request_id': 'req-5d1fac61-a595-4554-8e9b-05c63c641ae5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:28.968859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e60736ed0b4485b370bd799ce1277e', 'request_id': 'req-5d1fac61-a595-4554-8e9b-05c63c641ae5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:28.995374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4ff6-e91d-4876-8f8c-d766a008f907 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:28.995970 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4ff6-e91d-4876-8f8c-d766a008f907 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:28.995970 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb4ff6-e91d-4876-8f8c-d766a008f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.040942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-18cb4ff6-e91d-4876-8f8c-d766a008f907 None None] MFA Rules not processed for user `9e9848da15ea4ddfbceaf556423ba852`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:29.042180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-18cb4ff6-e91d-4876-8f8c-d766a008f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:29.130672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1137/2255] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:02:29.134839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e60736ed0b4485b370bd799ce1277e', 'request_id': 'req-5d1fac61-a595-4554-8e9b-05c63c641ae5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:29.135914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb4ff6-e91d-4876-8f8c-d766a008f907 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:29.138757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-18cb4ff6-e91d-4876-8f8c-d766a008f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:29.165956 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] The token cache is being invalidate because project 18e60736ed0b4485b370bd799ce1277e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:29.165956 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:29.165956 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-5d1fac61-a595-4554-8e9b-05c63c641ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:29.171927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1119/2256] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:28 2022] DELETE /identity/v3/projects/18e60736ed0b4485b370bd799ce1277e => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:29.175054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244ab2b-8684-41f6-a43b-0b5237e90f46 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.175351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244ab2b-8684-41f6-a43b-0b5237e90f46 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.175678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244ab2b-8684-41f6-a43b-0b5237e90f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.202743 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a244ab2b-8684-41f6-a43b-0b5237e90f46 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:29.204975 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a244ab2b-8684-41f6-a43b-0b5237e90f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:29.254310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb4ff6-e91d-4876-8f8c-d766a008f907 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:29.265367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:29.266415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.267445 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.267822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.269332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:29.271858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:29.337400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1120/2257] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:29.339394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205d63-f57b-41a3-9d69-8d44382cf8d8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.340135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205d63-f57b-41a3-9d69-8d44382cf8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.340135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8205d63-f57b-41a3-9d69-8d44382cf8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.392791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d8205d63-f57b-41a3-9d69-8d44382cf8d8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:29.394661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d8205d63-f57b-41a3-9d69-8d44382cf8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:29.397851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1138/2258] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:29 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:29.405435 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:29.408206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:29.552792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d65e23-a8e3-4d37-8add-9ba61ab597d1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:29.561406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1121/2259] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:29.567599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205d63-f57b-41a3-9d69-8d44382cf8d8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:29.571409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e374-5a96-4e98-bf54-89792bb7dea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:29.572548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e374-5a96-4e98-bf54-89792bb7dea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.573022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e374-5a96-4e98-bf54-89792bb7dea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.573734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e374-5a96-4e98-bf54-89792bb7dea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.575693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3e374-5a96-4e98-bf54-89792bb7dea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:29.581295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3e374-5a96-4e98-bf54-89792bb7dea3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:29.586435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8205d63-f57b-41a3-9d69-8d44382cf8d8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:29.600581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:29.601530 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.601881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.602945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.603758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:29.604080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:29.605770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:29.621419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1122/2260] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:02:29.626669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:29.643366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ec8cc-c110-4352-b205-1f4497cd811a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:29.650134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1c4a-f96a-4124-aba9-be3733b229b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:29.650940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1c4a-f96a-4124-aba9-be3733b229b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.651319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1c4a-f96a-4124-aba9-be3733b229b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.651796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f1c4a-f96a-4124-aba9-be3733b229b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.652841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f1c4a-f96a-4124-aba9-be3733b229b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:29.656038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f1c4a-f96a-4124-aba9-be3733b229b6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:29.730475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1139/2261] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:29 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:29.735018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e374-5a96-4e98-bf54-89792bb7dea3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:29.748217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e374-5a96-4e98-bf54-89792bb7dea3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:29.754167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bc0d-5f1b-4592-bed0-4840a0bf5294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:29.754914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bc0d-5f1b-4592-bed0-4840a0bf5294 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.755206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bc0d-5f1b-4592-bed0-4840a0bf5294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.755488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66bc0d-5f1b-4592-bed0-4840a0bf5294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.756240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66bc0d-5f1b-4592-bed0-4840a0bf5294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:29.758523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66bc0d-5f1b-4592-bed0-4840a0bf5294 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:29.776618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1140/2262] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:02:29.781188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bc0d-5f1b-4592-bed0-4840a0bf5294 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:29.794999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66bc0d-5f1b-4592-bed0-4840a0bf5294 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:29.804179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33ee7b-3353-4001-828c-df03bb690dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:29.805159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33ee7b-3353-4001-828c-df03bb690dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.805468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33ee7b-3353-4001-828c-df03bb690dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.805769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33ee7b-3353-4001-828c-df03bb690dad admin admin] PATH_INFO: `/v3/projects/ccea29c3839345c2b8f3726ea2100bed/users/30969bf8949f4f8793a0003096c939cd/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.826797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33ee7b-3353-4001-828c-df03bb690dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccea29c3839345c2b8f3726ea2100bed, user_id=30969bf8949f4f8793a0003096c939cd, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:29.830613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33ee7b-3353-4001-828c-df03bb690dad admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:29.858741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1123/2263] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:29 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:29.864217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1c4a-f96a-4124-aba9-be3733b229b6 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:29.958173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f1c4a-f96a-4124-aba9-be3733b229b6 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:29.978851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1290f-1b54-49a5-9538-3f70f3d29ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:29.980694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1290f-1b54-49a5-9538-3f70f3d29ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:29.981215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1290f-1b54-49a5-9538-3f70f3d29ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:29.983080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1290f-1b54-49a5-9538-3f70f3d29ffc admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:29.983282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1141/2264] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:29 2022] PUT /identity/v3/projects/ccea29c3839345c2b8f3726ea2100bed/users/30969bf8949f4f8793a0003096c939cd/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:29.984760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1290f-1b54-49a5-9538-3f70f3d29ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:29.987795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1290f-1b54-49a5-9538-3f70f3d29ffc admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:29.993070 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33ee7b-3353-4001-828c-df03bb690dad admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:30.085262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33ee7b-3353-4001-828c-df03bb690dad admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:30.102678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd03260-2abe-4018-9e9c-80f010c02afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:30.103742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03260-2abe-4018-9e9c-80f010c02afa admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:30.104369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03260-2abe-4018-9e9c-80f010c02afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:30.104684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd03260-2abe-4018-9e9c-80f010c02afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:30.105517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd03260-2abe-4018-9e9c-80f010c02afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:30.108994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd03260-2abe-4018-9e9c-80f010c02afa admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:30.124943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1142/2265] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:30.125154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1124/2266] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:29 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:30.126813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1290f-1b54-49a5-9538-3f70f3d29ffc admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:30.127442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd03260-2abe-4018-9e9c-80f010c02afa admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:30.141234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd03260-2abe-4018-9e9c-80f010c02afa admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:30.146094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1290f-1b54-49a5-9538-3f70f3d29ffc admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:30.152206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdfb96-6b80-436a-9a68-ffead0aed846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:30.152892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdfb96-6b80-436a-9a68-ffead0aed846 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:30.153199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdfb96-6b80-436a-9a68-ffead0aed846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:30.153452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdfb96-6b80-436a-9a68-ffead0aed846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:30.154229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdfb96-6b80-436a-9a68-ffead0aed846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:30.158990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdfb96-6b80-436a-9a68-ffead0aed846 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:30.159574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a663e-1774-493a-b02b-c2b6b9c93e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:30.162552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a663e-1774-493a-b02b-c2b6b9c93e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:30.163349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a663e-1774-493a-b02b-c2b6b9c93e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:30.163878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a663e-1774-493a-b02b-c2b6b9c93e65 admin admin] PATH_INFO: `/v3/projects/ccea29c3839345c2b8f3726ea2100bed/users/30969bf8949f4f8793a0003096c939cd/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:30.166352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a663e-1774-493a-b02b-c2b6b9c93e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccea29c3839345c2b8f3726ea2100bed, user_id=30969bf8949f4f8793a0003096c939cd, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:30.170791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a663e-1774-493a-b02b-c2b6b9c93e65 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:30.172529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1143/2267] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:30.176924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdfb96-6b80-436a-9a68-ffead0aed846 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:30.191572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1125/2268] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:30 2022] PUT /identity/v3/projects/ccea29c3839345c2b8f3726ea2100bed/users/30969bf8949f4f8793a0003096c939cd/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:30.201698 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdfb96-6b80-436a-9a68-ffead0aed846 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:30.322504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f548e5-1668-4129-9249-848d09e60423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:30.323434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f548e5-1668-4129-9249-848d09e60423 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:30.323764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f548e5-1668-4129-9249-848d09e60423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:30.324340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f548e5-1668-4129-9249-848d09e60423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:30.328422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f548e5-1668-4129-9249-848d09e60423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:30.335459 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f548e5-1668-4129-9249-848d09e60423 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:30.352781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1144/2269] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:02:30.361109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a663e-1774-493a-b02b-c2b6b9c93e65 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:30.380267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a663e-1774-493a-b02b-c2b6b9c93e65 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:30.387512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:30.388486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:30.388771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:30.389450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] PATH_INFO: `/v3/projects/9beb16c610a94371b896183858e4c1d5/users/e4eae42e04bd49ecae3fd63cd5b52a43/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:30.418742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9beb16c610a94371b896183858e4c1d5, user_id=e4eae42e04bd49ecae3fd63cd5b52a43, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:30.423829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:30.560933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1126/2270] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:30 2022] PUT /identity/v3/projects/9beb16c610a94371b896183858e4c1d5/users/e4eae42e04bd49ecae3fd63cd5b52a43/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:30.568927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e0721-236e-4a02-a5e6-b1f5a8e2d742 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:30.569412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e0721-236e-4a02-a5e6-b1f5a8e2d742 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:30.569993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e0721-236e-4a02-a5e6-b1f5a8e2d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:30.598109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e04e0721-236e-4a02-a5e6-b1f5a8e2d742 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:30.600156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e04e0721-236e-4a02-a5e6-b1f5a8e2d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:30.716398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1145/2271] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:30.742393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:30.744793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:30.812740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b40c5-8f19-4b96-b089-803697718413 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:30.818653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:30.827109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:30.827716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:30.828181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:30.838920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:30.840555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:30.853182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1127/2272] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:31.090752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:32.775458 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:32.881539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e3c1-0bfc-4464-afac-907920a82c2d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:32.881977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e3c1-0bfc-4464-afac-907920a82c2d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:32.881977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e3c1-0bfc-4464-afac-907920a82c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:32.924393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0a26e3c1-0bfc-4464-afac-907920a82c2d None None] MFA Rules not processed for user `e4eae42e04bd49ecae3fd63cd5b52a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:32.925952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0a26e3c1-0bfc-4464-afac-907920a82c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:33.085376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1146/2273] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:33.097557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:33.101864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:33.215888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94702cc-a7ea-4456-8d32-d14a8b0ad713 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:33.221510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b35f2-0918-4124-b425-dcd8c39a6987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:33.222467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b35f2-0918-4124-b425-dcd8c39a6987 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:33.222936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b35f2-0918-4124-b425-dcd8c39a6987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:33.223368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b35f2-0918-4124-b425-dcd8c39a6987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:33.235950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b35f2-0918-4124-b425-dcd8c39a6987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:33.238045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b35f2-0918-4124-b425-dcd8c39a6987 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:33.260403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1128/2274] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:33.407083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:35.417446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd453fcc-48a9-463f-be12-ee20ec1a912d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:35.418387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd453fcc-48a9-463f-be12-ee20ec1a912d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:35.418814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd453fcc-48a9-463f-be12-ee20ec1a912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:35.425632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b35f2-0918-4124-b425-dcd8c39a6987 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:35.439531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b35f2-0918-4124-b425-dcd8c39a6987 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:35.444318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:35.445701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:35.446253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:35.446842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:35.449146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:35.450839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-dd453fcc-48a9-463f-be12-ee20ec1a912d None None] MFA Rules not processed for user `e4eae42e04bd49ecae3fd63cd5b52a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:35.452178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dd453fcc-48a9-463f-be12-ee20ec1a912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:35.464498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1147/2275] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:35.596802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:35.598511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:35.612615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1129/2276] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:35.670695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:35.958576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:38.701251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:38.979792 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8615-be44-4ba9-b6f1-8c1d6dcb6ea8 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:38.980282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8615-be44-4ba9-b6f1-8c1d6dcb6ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:38.980723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f8615-be44-4ba9-b6f1-8c1d6dcb6ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:39.037516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1c8f8615-be44-4ba9-b6f1-8c1d6dcb6ea8 None None] MFA Rules not processed for user `30969bf8949f4f8793a0003096c939cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:39.040592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1c8f8615-be44-4ba9-b6f1-8c1d6dcb6ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:39.220374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1148/2277] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:39.253980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:39.259003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:39.262353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:39.409283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3829f01-da67-4669-9925-c5585c4f43c0 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:39.419484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:39.420995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:39.420995 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:39.421291 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:39.423632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:39.541781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:39.544273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:39.563114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1130/2278] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:43.798762 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:43.982422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375462f8-13a6-4097-8dc5-18562666f8e4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:43.982422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375462f8-13a6-4097-8dc5-18562666f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:43.982422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375462f8-13a6-4097-8dc5-18562666f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:44.002544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-375462f8-13a6-4097-8dc5-18562666f8e4 None None] MFA Rules not processed for user `9e9848da15ea4ddfbceaf556423ba852`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:44.003797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-375462f8-13a6-4097-8dc5-18562666f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:44.011798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1149/2279] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:44.062351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:45.648579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:46.666974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:47.186466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:47.706349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:48.042513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:48.495156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:49.009007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:49.854670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:51.580960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:52.411154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:52.904735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:52.905468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:53.036134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add292c1-8b17-41af-82a9-d83b695db3f6 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:53.042023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:53.043138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:53.043602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:53.043863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] PATH_INFO: `/v3/users/2128fdb6b2184c95899aec3582600aa9` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:53.048487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2128fdb6b2184c95899aec3582600aa9)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:53.051153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:53.500447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375462f8-13a6-4097-8dc5-18562666f8e4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:53.500447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-375462f8-13a6-4097-8dc5-18562666f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:53.508213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2128fdb6b2184c95899aec3582600aa9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:53.510774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2128fdb6b2184c95899aec3582600aa9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:53.535125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2128fdb6b2184c95899aec3582600aa9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:53.537561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2128fdb6b2184c95899aec3582600aa9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:53.598372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375462f8-13a6-4097-8dc5-18562666f8e4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:53.603634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:53.604523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:53.604808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:53.605081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] PATH_INFO: `/v3/users/66dab395a6c6436589af158c08d025ee` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:53.606620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66dab395a6c6436589af158c08d025ee)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:53.608826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:53.660357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-11273529-8231-4974-82ba-b5bccf89780c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2128fdb6b2184c95899aec3582600aa9'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:53.686092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1131/2280] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:52 2022] DELETE /identity/v3/users/2128fdb6b2184c95899aec3582600aa9 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:53.689553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6865-8b44-4d83-a9df-90360cd9c0a6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:53.689983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6865-8b44-4d83-a9df-90360cd9c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:53.690355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6865-8b44-4d83-a9df-90360cd9c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:53.725828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-389a6865-8b44-4d83-a9df-90360cd9c0a6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:53.726969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-389a6865-8b44-4d83-a9df-90360cd9c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:53.833795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1132/2281] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:53.862204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a6865-8b44-4d83-a9df-90360cd9c0a6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:53.866862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-389a6865-8b44-4d83-a9df-90360cd9c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:53.874008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66dab395a6c6436589af158c08d025ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:53.878124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66dab395a6c6436589af158c08d025ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:53.878124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66dab395a6c6436589af158c08d025ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:53.992939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66dab395a6c6436589af158c08d025ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:54.038387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fbcea271-fdfd-4c06-a489-c4d3d86a25b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66dab395a6c6436589af158c08d025ee'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:54.068332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1150/2282] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:02:53 2022] DELETE /identity/v3/users/66dab395a6c6436589af158c08d025ee => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:54.068787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a6865-8b44-4d83-a9df-90360cd9c0a6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:54.074914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4014-2d54-4fcc-9300-8e1fd22e5fa2 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:54.075211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4014-2d54-4fcc-9300-8e1fd22e5fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:54.075596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4014-2d54-4fcc-9300-8e1fd22e5fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:54.096465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-bf3a4014-2d54-4fcc-9300-8e1fd22e5fa2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:54.098570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bf3a4014-2d54-4fcc-9300-8e1fd22e5fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:54.145127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:54.156780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:54.159472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:54.160153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:54.160814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:54.164502 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:54.222751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1151/2283] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:54.236543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a4014-2d54-4fcc-9300-8e1fd22e5fa2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:54.239345 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-bf3a4014-2d54-4fcc-9300-8e1fd22e5fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:54.253850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a4014-2d54-4fcc-9300-8e1fd22e5fa2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:54.258964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6613ef-1000-4add-82fc-ffffa2b774ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:54.258964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6613ef-1000-4add-82fc-ffffa2b774ff service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:54.259230 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6613ef-1000-4add-82fc-ffffa2b774ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:54.259764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6613ef-1000-4add-82fc-ffffa2b774ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:54.273101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6613ef-1000-4add-82fc-ffffa2b774ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:54.275616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6613ef-1000-4add-82fc-ffffa2b774ff service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:54.285839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:54.287590 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:54.292084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1152/2284] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:02:54.304418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1133/2285] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:54.806087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36fe8-4371-4019-b359-1928386a98ea None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:54.806688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36fe8-4371-4019-b359-1928386a98ea None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:54.806841 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36fe8-4371-4019-b359-1928386a98ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:54.830959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9ac36fe8-4371-4019-b359-1928386a98ea None None] MFA Rules not processed for user `cf981e5982644d708ddaba93a12b2b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:54.832157 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9ac36fe8-4371-4019-b359-1928386a98ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:54.903820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:54.905257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:54.918235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1153/2286] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:54.930727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95bed6-4b7f-4733-a06b-f2d5bc79b6d7 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:54.944524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:54.946472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:54.946552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:54.947010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] PATH_INFO: `/v3/projects/0b7585cd2b10479ca6b3926444da1813` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:54.949692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7585cd2b10479ca6b3926444da1813)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:54.953621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:55.185485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7585cd2b10479ca6b3926444da1813', 'request_id': 'req-c38faf0b-09af-4b0f-aa27-18883e59e971'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.192585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7585cd2b10479ca6b3926444da1813', 'request_id': 'req-c38faf0b-09af-4b0f-aa27-18883e59e971'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.245830 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac36fe8-4371-4019-b359-1928386a98ea None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:55.252693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9ac36fe8-4371-4019-b359-1928386a98ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:55.272739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac36fe8-4371-4019-b359-1928386a98ea None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:55.286591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7585cd2b10479ca6b3926444da1813', 'request_id': 'req-c38faf0b-09af-4b0f-aa27-18883e59e971'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.303078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] The token cache is being invalidate because project 0b7585cd2b10479ca6b3926444da1813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:55.303608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.304535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c38faf0b-09af-4b0f-aa27-18883e59e971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.306703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1134/2287] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:54 2022] DELETE /identity/v3/projects/0b7585cd2b10479ca6b3926444da1813 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:55.314046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baea7d-4562-458a-bffd-d1d2c68050f7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.314505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baea7d-4562-458a-bffd-d1d2c68050f7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.314842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baea7d-4562-458a-bffd-d1d2c68050f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.352722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:55.374324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-23baea7d-4562-458a-bffd-d1d2c68050f7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:55.376588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-23baea7d-4562-458a-bffd-d1d2c68050f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:55.408489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:55.409896 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.410400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.410920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] PATH_INFO: `/v3/projects/a04f36b2f3ed48b0abc7f86521cc0653` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.412426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04f36b2f3ed48b0abc7f86521cc0653)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:55.414724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:55.468415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1135/2288] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:55.479213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ce71-e303-4021-a7fc-3bc455edd928 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.479658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ce71-e303-4021-a7fc-3bc455edd928 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.480031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ce71-e303-4021-a7fc-3bc455edd928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.501916 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fe53ce71-e303-4021-a7fc-3bc455edd928 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:55.503269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fe53ce71-e303-4021-a7fc-3bc455edd928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:55.512067 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1136/2289] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:02:55.516578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ce71-e303-4021-a7fc-3bc455edd928 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:55.526459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ce71-e303-4021-a7fc-3bc455edd928 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:55.533600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:55.534520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.534808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.535087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.535842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:55.536161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:55.537923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:55.555943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1137/2290] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:02:55.557151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:55.571271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790f5e2-5e6c-46b0-ac0c-6aab2e50235d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:55.574986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b17b-bced-4294-8a75-7278e2286da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:55.575719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b17b-bced-4294-8a75-7278e2286da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.576008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b17b-bced-4294-8a75-7278e2286da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.576288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801b17b-bced-4294-8a75-7278e2286da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.577015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801b17b-bced-4294-8a75-7278e2286da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:55.579180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801b17b-bced-4294-8a75-7278e2286da8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:55.651058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04f36b2f3ed48b0abc7f86521cc0653', 'request_id': 'req-e157a79c-31ef-4b91-a232-abf223883713'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.658336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04f36b2f3ed48b0abc7f86521cc0653', 'request_id': 'req-e157a79c-31ef-4b91-a232-abf223883713'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.665130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04f36b2f3ed48b0abc7f86521cc0653', 'request_id': 'req-e157a79c-31ef-4b91-a232-abf223883713'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.726999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1138/2291] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:55 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:55.731723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b17b-bced-4294-8a75-7278e2286da8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:55.758173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] The token cache is being invalidate because project a04f36b2f3ed48b0abc7f86521cc0653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:02:55.758480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.759274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e157a79c-31ef-4b91-a232-abf223883713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:02:55.760955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1154/2292] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:02:55 2022] DELETE /identity/v3/projects/a04f36b2f3ed48b0abc7f86521cc0653 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:55.766721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dddc2b-895a-4073-ab51-0570a02e9842 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.767183 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dddc2b-895a-4073-ab51-0570a02e9842 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.767567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dddc2b-895a-4073-ab51-0570a02e9842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.787998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-21dddc2b-895a-4073-ab51-0570a02e9842 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:55.789237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-21dddc2b-895a-4073-ab51-0570a02e9842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:55.812554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801b17b-bced-4294-8a75-7278e2286da8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:55.817830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:55.818564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.818897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.819166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.820175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:55.822301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:55.870789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1155/2293] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:55.880372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c102-aa8c-43fd-a164-4a9bf9708fc4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.880665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c102-aa8c-43fd-a164-4a9bf9708fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.881127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c102-aa8c-43fd-a164-4a9bf9708fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.906749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-db36c102-aa8c-43fd-a164-4a9bf9708fc4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:55.908526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-db36c102-aa8c-43fd-a164-4a9bf9708fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:55.920158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1156/2294] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:02:55.926457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36c102-aa8c-43fd-a164-4a9bf9708fc4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:55.940536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36c102-aa8c-43fd-a164-4a9bf9708fc4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:55.947181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:55.947843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1139/2295] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:55 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:55.954179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.954179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.954179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.954179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:02:55.954179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:55.954579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:55.956097 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:55.957840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:55.971089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1157/2296] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:02:55.975404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:55.977255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a260fc3-1d36-4631-9e5f-a33d2a7fa814 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:55.982639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293617d-7a07-48f1-a340-7afd4ae6b2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:55.983394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293617d-7a07-48f1-a340-7afd4ae6b2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.983688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293617d-7a07-48f1-a340-7afd4ae6b2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.984498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293617d-7a07-48f1-a340-7afd4ae6b2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.985247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293617d-7a07-48f1-a340-7afd4ae6b2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:55.987107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293617d-7a07-48f1-a340-7afd4ae6b2d4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:55.987993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32101516-1f56-48ec-8155-fe0afaaf9309 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:55.993163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9d01-cc1a-4a3b-ba2a-36eaf9e7ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:55.993900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9d01-cc1a-4a3b-ba2a-36eaf9e7ff51 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:55.994282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9d01-cc1a-4a3b-ba2a-36eaf9e7ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:55.994660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb9d01-cc1a-4a3b-ba2a-36eaf9e7ff51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:55.995423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb9d01-cc1a-4a3b-ba2a-36eaf9e7ff51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:55.997486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb9d01-cc1a-4a3b-ba2a-36eaf9e7ff51 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:56.001823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1140/2297] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:56.003013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293617d-7a07-48f1-a340-7afd4ae6b2d4 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:56.013091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293617d-7a07-48f1-a340-7afd4ae6b2d4 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:56.020418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad1905-f568-44ee-8a0c-c7fc66ab6c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:56.020418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad1905-f568-44ee-8a0c-c7fc66ab6c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.020418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad1905-f568-44ee-8a0c-c7fc66ab6c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.020418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad1905-f568-44ee-8a0c-c7fc66ab6c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.020820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad1905-f568-44ee-8a0c-c7fc66ab6c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:56.021993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad1905-f568-44ee-8a0c-c7fc66ab6c6e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:56.032885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1141/2298] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:56.037313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad1905-f568-44ee-8a0c-c7fc66ab6c6e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:56.047795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad1905-f568-44ee-8a0c-c7fc66ab6c6e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:56.052710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a6752-21c4-41d5-8f73-771920e81b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:56.053626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6752-21c4-41d5-8f73-771920e81b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.053908 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6752-21c4-41d5-8f73-771920e81b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.054219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a6752-21c4-41d5-8f73-771920e81b5d admin admin] PATH_INFO: `/v3/projects/9dda8e1884e646449cc8ac7096f3dbac/users/05c318e5ecca4c6c80c629b184bf366c/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.069989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a6752-21c4-41d5-8f73-771920e81b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dda8e1884e646449cc8ac7096f3dbac, user_id=05c318e5ecca4c6c80c629b184bf366c, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:56.076894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a6752-21c4-41d5-8f73-771920e81b5d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:56.135878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1158/2299] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:02:55 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:02:56.137176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9d01-cc1a-4a3b-ba2a-36eaf9e7ff51 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:56.165534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1142/2300] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:56 2022] PUT /identity/v3/projects/9dda8e1884e646449cc8ac7096f3dbac/users/05c318e5ecca4c6c80c629b184bf366c/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:02:56.195523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe262fb-e91c-4bf7-9167-6c0db06a0cc0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.196174 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe262fb-e91c-4bf7-9167-6c0db06a0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.196174 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe262fb-e91c-4bf7-9167-6c0db06a0cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.236920 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dfe262fb-e91c-4bf7-9167-6c0db06a0cc0 None None] MFA Rules not processed for user `05c318e5ecca4c6c80c629b184bf366c`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:56.238401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dfe262fb-e91c-4bf7-9167-6c0db06a0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:56.258678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb9d01-cc1a-4a3b-ba2a-36eaf9e7ff51 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:56.281260 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:56.354381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6e72b-1649-4ec3-9eec-a7315014bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:56.355323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e72b-1649-4ec3-9eec-a7315014bb14 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.355677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e72b-1649-4ec3-9eec-a7315014bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.356150 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e72b-1649-4ec3-9eec-a7315014bb14 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.357262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6e72b-1649-4ec3-9eec-a7315014bb14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:56.361802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6e72b-1649-4ec3-9eec-a7315014bb14 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:56.366299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1143/2301] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:56.376353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe262fb-e91c-4bf7-9167-6c0db06a0cc0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:56.378091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dfe262fb-e91c-4bf7-9167-6c0db06a0cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:56.445637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe262fb-e91c-4bf7-9167-6c0db06a0cc0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:56.449382 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a59d5-d062-4de2-abf2-fd6492fb2944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:56.450027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a59d5-d062-4de2-abf2-fd6492fb2944 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.450368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a59d5-d062-4de2-abf2-fd6492fb2944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.450657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a59d5-d062-4de2-abf2-fd6492fb2944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.462607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a59d5-d062-4de2-abf2-fd6492fb2944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:56.464440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a59d5-d062-4de2-abf2-fd6492fb2944 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:56.475843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1144/2302] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:02:56.519172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1159/2303] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:02:56 2022] POST /identity/v3/users => generated 288 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:02:56.520996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a59d5-d062-4de2-abf2-fd6492fb2944 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:56.540145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a59d5-d062-4de2-abf2-fd6492fb2944 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:56.548735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bc8c0-1c92-45b1-b02e-f3b050e712e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:56.550170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc8c0-1c92-45b1-b02e-f3b050e712e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.550576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc8c0-1c92-45b1-b02e-f3b050e712e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.551048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc8c0-1c92-45b1-b02e-f3b050e712e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.552339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bc8c0-1c92-45b1-b02e-f3b050e712e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:56.556090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bc8c0-1c92-45b1-b02e-f3b050e712e6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:56.583393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1145/2304] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:56.585708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6e72b-1649-4ec3-9eec-a7315014bb14 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:56.615879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6e72b-1649-4ec3-9eec-a7315014bb14 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:56.635855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6b32b-5eab-418d-9093-7241f726bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:56.636722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6b32b-5eab-418d-9093-7241f726bdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.637109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6b32b-5eab-418d-9093-7241f726bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.637483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6b32b-5eab-418d-9093-7241f726bdb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.638556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6b32b-5eab-418d-9093-7241f726bdb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:56.640403 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6b32b-5eab-418d-9093-7241f726bdb1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:56.670997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1160/2305] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:02:56.674630 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bc8c0-1c92-45b1-b02e-f3b050e712e6 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:56.692813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bc8c0-1c92-45b1-b02e-f3b050e712e6 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:56.701596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:56.703172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.703460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.703744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] PATH_INFO: `/v3/projects/8f42c2bc59f44516848a6eee3e1b207e/users/1b08186378344d5d824d6d25e60de813/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.730918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f42c2bc59f44516848a6eee3e1b207e, user_id=1b08186378344d5d824d6d25e60de813, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:56.730918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:56.836558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1146/2306] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:02:56 2022] PUT /identity/v3/projects/8f42c2bc59f44516848a6eee3e1b207e/users/1b08186378344d5d824d6d25e60de813/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:02:56.847426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061a2-8bd3-4430-9e61-fcd328c8f718 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:56.852967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061a2-8bd3-4430-9e61-fcd328c8f718 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:56.852967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061a2-8bd3-4430-9e61-fcd328c8f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:56.881015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a4d061a2-8bd3-4430-9e61-fcd328c8f718 None None] MFA Rules not processed for user `1b08186378344d5d824d6d25e60de813`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:02:56.882324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a4d061a2-8bd3-4430-9e61-fcd328c8f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:56.994782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1161/2307] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:02:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:02:57.012767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:02:57.016135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:02:57.102753 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056e8cd-b395-4be3-8735-ba37cb853455 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:02:57.108141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac1543-6da0-4b97-97b8-535e526c5497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:02:57.109179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac1543-6da0-4b97-97b8-535e526c5497 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:02:57.109494 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac1543-6da0-4b97-97b8-535e526c5497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:02:57.109796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac1543-6da0-4b97-97b8-535e526c5497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:02:57.120890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac1543-6da0-4b97-97b8-535e526c5497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:02:57.122695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac1543-6da0-4b97-97b8-535e526c5497 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:02:57.143126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1147/2308] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:02:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:02:57.918634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:02:59.880272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:00.316687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d061a2-8bd3-4430-9e61-fcd328c8f718 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:00.463995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d061a2-8bd3-4430-9e61-fcd328c8f718 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:00.478814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:00.479999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:00.480454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:00.480733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] PATH_INFO: `/v3/users/05c318e5ecca4c6c80c629b184bf366c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:00.483016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c318e5ecca4c6c80c629b184bf366c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:00.485751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:00.873095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:00.946012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c318e5ecca4c6c80c629b184bf366c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:00.946810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c318e5ecca4c6c80c629b184bf366c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:00.947439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c318e5ecca4c6c80c629b184bf366c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:01.095045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c318e5ecca4c6c80c629b184bf366c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:01.121189 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c318e5ecca4c6c80c629b184bf366c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:01.147060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1162/2309] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:00 2022] DELETE /identity/v3/users/05c318e5ecca4c6c80c629b184bf366c => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:03:01.154990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca75b5-58a1-414e-bf5d-9811303a3503 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:01.156613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca75b5-58a1-414e-bf5d-9811303a3503 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:01.157077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca75b5-58a1-414e-bf5d-9811303a3503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:01.183307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-75ca75b5-58a1-414e-bf5d-9811303a3503 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:01.185423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-75ca75b5-58a1-414e-bf5d-9811303a3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:01.290850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1148/2310] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:01.304750 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:01.307342 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:01.396556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48dd26-1313-4b3c-99a5-ef2d4130d3a5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:01.403904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:01.405126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:01.405464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:01.405950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:01.426320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:01.429917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:01.445210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1163/2311] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:03:02.993832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b9d0a-e0d1-4f9d-9f2c-47c1fc3be675 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:02.994486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b9d0a-e0d1-4f9d-9f2c-47c1fc3be675 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:02.994941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b9d0a-e0d1-4f9d-9f2c-47c1fc3be675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:03.016868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-141b9d0a-e0d1-4f9d-9f2c-47c1fc3be675 None None] MFA Rules not processed for user `c5c6763ac1ea47da89d3bb29d630b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:03.018764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-141b9d0a-e0d1-4f9d-9f2c-47c1fc3be675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:03.047456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:03.048988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:03.088385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b60f9-98b6-49db-aacd-0cdb7d465f4b service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:03.101352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:03.102592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:03.102873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:03.103413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] PATH_INFO: `/v3/projects/9dda8e1884e646449cc8ac7096f3dbac` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:03.104606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dda8e1884e646449cc8ac7096f3dbac)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:03.107875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:03.129255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1149/2312] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:03.270311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:03.293148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dda8e1884e646449cc8ac7096f3dbac', 'request_id': 'req-b7516244-084c-46d9-8122-18bf78982553'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:03.301504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dda8e1884e646449cc8ac7096f3dbac', 'request_id': 'req-b7516244-084c-46d9-8122-18bf78982553'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:03.308297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dda8e1884e646449cc8ac7096f3dbac', 'request_id': 'req-b7516244-084c-46d9-8122-18bf78982553'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:03.415820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] The token cache is being invalidate because project 9dda8e1884e646449cc8ac7096f3dbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:03.422823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:03.422823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b7516244-084c-46d9-8122-18bf78982553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:03.422823 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1164/2313] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:03 2022] DELETE /identity/v3/projects/9dda8e1884e646449cc8ac7096f3dbac => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:03.424456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fd0e5-2b84-4daa-a8d4-04375ee9027f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:03.424944 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fd0e5-2b84-4daa-a8d4-04375ee9027f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:03.425387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fd0e5-2b84-4daa-a8d4-04375ee9027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:03.460096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8b5fd0e5-2b84-4daa-a8d4-04375ee9027f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:03.461424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8b5fd0e5-2b84-4daa-a8d4-04375ee9027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:03.539014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1150/2314] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:03.552340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb2f4-2037-410d-900d-418c22677d76 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:03.552637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb2f4-2037-410d-900d-418c22677d76 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:03.552924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb2f4-2037-410d-900d-418c22677d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:03.591002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-503fb2f4-2037-410d-900d-418c22677d76 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:03.591002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-503fb2f4-2037-410d-900d-418c22677d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:03.591002 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1165/2315] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:03.592639 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fd0e5-2b84-4daa-a8d4-04375ee9027f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:03.603226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fd0e5-2b84-4daa-a8d4-04375ee9027f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:03.609808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:03.610801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:03.611078 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:03.611510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:03.612405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:03:03.613007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:03.614847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:03.630309 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1151/2316] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:03:03.634083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb2f4-2037-410d-900d-418c22677d76 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:03.645831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb2f4-2037-410d-900d-418c22677d76 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:03.652695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dc099-f6f5-4c16-b998-7f0f2e65afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:03.653381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dc099-f6f5-4c16-b998-7f0f2e65afd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:03.653660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dc099-f6f5-4c16-b998-7f0f2e65afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:03.653933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dc099-f6f5-4c16-b998-7f0f2e65afd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:03.654736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dc099-f6f5-4c16-b998-7f0f2e65afd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:03.656856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dc099-f6f5-4c16-b998-7f0f2e65afd4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:03.787604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:03.798767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1166/2317] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:03:03 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:03:03.801676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:03.812898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a87697-a18d-4e88-aa21-63d9d3613313 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:03.894667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fe59b-92b5-440f-8ef9-9353231d3f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:03.895358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe59b-92b5-440f-8ef9-9353231d3f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:03.895912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe59b-92b5-440f-8ef9-9353231d3f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:03.896194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fe59b-92b5-440f-8ef9-9353231d3f4f admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:03.896894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fe59b-92b5-440f-8ef9-9353231d3f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:03.899046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fe59b-92b5-440f-8ef9-9353231d3f4f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:04.153088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1152/2318] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:03:03 2022] POST /identity/v3/users => generated 283 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:03:04.158221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dc099-f6f5-4c16-b998-7f0f2e65afd4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:04.170568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dc099-f6f5-4c16-b998-7f0f2e65afd4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:04.176256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401dc67-2799-436c-91ae-0bdff281c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:04.176920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401dc67-2799-436c-91ae-0bdff281c32a admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:04.177205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401dc67-2799-436c-91ae-0bdff281c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:04.177477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401dc67-2799-436c-91ae-0bdff281c32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:04.178437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401dc67-2799-436c-91ae-0bdff281c32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:04.180015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401dc67-2799-436c-91ae-0bdff281c32a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:04.191019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1167/2319] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:03:04.195247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fe59b-92b5-440f-8ef9-9353231d3f4f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:04.206333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fe59b-92b5-440f-8ef9-9353231d3f4f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:04.211104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171fcad-399a-438b-b12e-d604f047b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:04.217765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fcad-399a-438b-b12e-d604f047b5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:04.217765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fcad-399a-438b-b12e-d604f047b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:04.217765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171fcad-399a-438b-b12e-d604f047b5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:04.217765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171fcad-399a-438b-b12e-d604f047b5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:04.217765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171fcad-399a-438b-b12e-d604f047b5aa admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:04.225581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1153/2320] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:03:04.229939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401dc67-2799-436c-91ae-0bdff281c32a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:04.241655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401dc67-2799-436c-91ae-0bdff281c32a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:04.246880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:04.247782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:04.248156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:04.248876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] PATH_INFO: `/v3/projects/cb1919e3e2b741ef8289d4be1d60acb5/users/9066c93bba054b058b4fa5f104392958/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:04.265920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1919e3e2b741ef8289d4be1d60acb5, user_id=9066c93bba054b058b4fa5f104392958, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:04.268669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:04.380549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1168/2321] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:03:04 2022] PUT /identity/v3/projects/cb1919e3e2b741ef8289d4be1d60acb5/users/9066c93bba054b058b4fa5f104392958/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:04.395028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a887ed-82d1-455b-8870-92edd25fe1a7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:04.395324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a887ed-82d1-455b-8870-92edd25fe1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:04.395692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a887ed-82d1-455b-8870-92edd25fe1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:04.432947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b4a887ed-82d1-455b-8870-92edd25fe1a7 None None] MFA Rules not processed for user `9066c93bba054b058b4fa5f104392958`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:04.434469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b4a887ed-82d1-455b-8870-92edd25fe1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:04.520551 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1154/2322] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:03:04.533124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:04.534876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:04.605739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea575cf-9f4a-4c48-8b5d-f6539d5cfff8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:04.611204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14410f78-6ef8-4ee3-a8c1-3648be6cb56f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:04.611875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410f78-6ef8-4ee3-a8c1-3648be6cb56f service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:04.612165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410f78-6ef8-4ee3-a8c1-3648be6cb56f service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:04.612491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410f78-6ef8-4ee3-a8c1-3648be6cb56f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:04.628466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14410f78-6ef8-4ee3-a8c1-3648be6cb56f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:04.633292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14410f78-6ef8-4ee3-a8c1-3648be6cb56f service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:04.650108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1169/2323] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:06.306454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:06.923355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:10.660940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:10.906224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:11.793473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a887ed-82d1-455b-8870-92edd25fe1a7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:11.796036 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b4a887ed-82d1-455b-8870-92edd25fe1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:11.901047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a887ed-82d1-455b-8870-92edd25fe1a7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:11.910618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:11.911526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:11.911812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:11.912235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] PATH_INFO: `/v3/users/4d77733154224b52ba9a8d573e99bf24` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:11.913507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d77733154224b52ba9a8d573e99bf24)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:11.915658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:11.976112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:12.297341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d77733154224b52ba9a8d573e99bf24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:12.298411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d77733154224b52ba9a8d573e99bf24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:12.306394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d77733154224b52ba9a8d573e99bf24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:12.307409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d77733154224b52ba9a8d573e99bf24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:12.392070 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d77733154224b52ba9a8d573e99bf24'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:12.425115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1155/2324] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:11 2022] DELETE /identity/v3/users/4d77733154224b52ba9a8d573e99bf24 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:03:12.428156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488671c-dcf5-4e31-b7de-9857f55310c4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:12.429064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488671c-dcf5-4e31-b7de-9857f55310c4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:12.429742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488671c-dcf5-4e31-b7de-9857f55310c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:12.460742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c488671c-dcf5-4e31-b7de-9857f55310c4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:12.461904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c488671c-dcf5-4e31-b7de-9857f55310c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:12.580530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1170/2325] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:12.587428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:12.590255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:12.655017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba6b4b-58fd-451f-8e21-bc260ef9fe40 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:12.659324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978e8d-aff7-4df5-bbda-adb64f9d9c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:12.660277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978e8d-aff7-4df5-bbda-adb64f9d9c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:12.660562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978e8d-aff7-4df5-bbda-adb64f9d9c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:12.660844 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab978e8d-aff7-4df5-bbda-adb64f9d9c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:12.671819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab978e8d-aff7-4df5-bbda-adb64f9d9c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:12.673296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab978e8d-aff7-4df5-bbda-adb64f9d9c81 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:12.686924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1156/2326] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:13.394466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488671c-dcf5-4e31-b7de-9857f55310c4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:13.396587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c488671c-dcf5-4e31-b7de-9857f55310c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:13.412034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488671c-dcf5-4e31-b7de-9857f55310c4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:13.425480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:13.427726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:13.428112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:13.428517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] PATH_INFO: `/v3/projects/f8fc6785f4fb47479e55b4c5872caf4c` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:13.431518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8fc6785f4fb47479e55b4c5872caf4c)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:13.434162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:13.741108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8fc6785f4fb47479e55b4c5872caf4c', 'request_id': 'req-c39910e2-4a33-4553-8a5c-e031f0e84205'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:13.759890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8fc6785f4fb47479e55b4c5872caf4c', 'request_id': 'req-c39910e2-4a33-4553-8a5c-e031f0e84205'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:13.772307 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8fc6785f4fb47479e55b4c5872caf4c', 'request_id': 'req-c39910e2-4a33-4553-8a5c-e031f0e84205'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:13.882197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] The token cache is being invalidate because project f8fc6785f4fb47479e55b4c5872caf4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:13.882492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:13.883204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:13.885298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1171/2327] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:13 2022] DELETE /identity/v3/projects/f8fc6785f4fb47479e55b4c5872caf4c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:13.897715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978e8d-aff7-4df5-bbda-adb64f9d9c81 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:13.911501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab978e8d-aff7-4df5-bbda-adb64f9d9c81 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:13.998396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:14.000365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:14.000679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:14.001379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] PATH_INFO: `/v3/users/a005228cc45c40eaad34dd946211dd27` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:14.006378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a005228cc45c40eaad34dd946211dd27)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:14.010536 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:14.020596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:14.320567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a005228cc45c40eaad34dd946211dd27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.321254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a005228cc45c40eaad34dd946211dd27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.330107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a005228cc45c40eaad34dd946211dd27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.332456 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a005228cc45c40eaad34dd946211dd27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.368466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:14.437546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f9ec2092-c695-45bb-b6f5-956969587b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a005228cc45c40eaad34dd946211dd27'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:14.459562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1157/2328] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:13 2022] DELETE /identity/v3/users/a005228cc45c40eaad34dd946211dd27 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:15.287910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:15.289426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:15.306913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39910e2-4a33-4553-8a5c-e031f0e84205 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:15.355239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabd19-bfc6-4929-805f-6c7494e1bb08 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:15.356226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabd19-bfc6-4929-805f-6c7494e1bb08 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:15.356375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fabd19-bfc6-4929-805f-6c7494e1bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:15.389178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-30fabd19-bfc6-4929-805f-6c7494e1bb08 None None] MFA Rules not processed for user `e4eae42e04bd49ecae3fd63cd5b52a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:15.392619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-30fabd19-bfc6-4929-805f-6c7494e1bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:15.408323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:15.409817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:15.410138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:15.410421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] PATH_INFO: `/v3/projects/ad3e6d72293f494682ca1d532740113f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:15.411664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3e6d72293f494682ca1d532740113f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:15.418326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:15.518043 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1158/2329] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:15.523337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fabd19-bfc6-4929-805f-6c7494e1bb08 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:15.525555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-30fabd19-bfc6-4929-805f-6c7494e1bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:15.543210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fabd19-bfc6-4929-805f-6c7494e1bb08 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:15.557329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:15.558727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:15.559017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:15.559294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] PATH_INFO: `/v3/users/1b08186378344d5d824d6d25e60de813` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:15.560753 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b08186378344d5d824d6d25e60de813)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:15.565394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:15.663579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3e6d72293f494682ca1d532740113f', 'request_id': 'req-e814a2be-6887-474d-b24b-919a0da0d549'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.674128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3e6d72293f494682ca1d532740113f', 'request_id': 'req-e814a2be-6887-474d-b24b-919a0da0d549'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.689682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3e6d72293f494682ca1d532740113f', 'request_id': 'req-e814a2be-6887-474d-b24b-919a0da0d549'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.875493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] The token cache is being invalidate because project ad3e6d72293f494682ca1d532740113f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:15.876546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.877745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e814a2be-6887-474d-b24b-919a0da0d549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.891862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1172/2330] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:15 2022] DELETE /identity/v3/projects/ad3e6d72293f494682ca1d532740113f => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:15.891862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177bf61-1dd7-470d-ad6f-c5be15030551 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:15.891862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177bf61-1dd7-470d-ad6f-c5be15030551 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:15.891862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177bf61-1dd7-470d-ad6f-c5be15030551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:15.922472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b08186378344d5d824d6d25e60de813'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.923697 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b08186378344d5d824d6d25e60de813'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.933218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b08186378344d5d824d6d25e60de813'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.934994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b08186378344d5d824d6d25e60de813'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:15.962038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0177bf61-1dd7-470d-ad6f-c5be15030551 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:15.964072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0177bf61-1dd7-470d-ad6f-c5be15030551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:16.056558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1173/2331] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:16.063032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c07f14db-644f-4dfa-bb75-0a2d2a18c8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b08186378344d5d824d6d25e60de813'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:16.067678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626bf2-5247-482c-bd0c-18a73a19cf5b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.072670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626bf2-5247-482c-bd0c-18a73a19cf5b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.072670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626bf2-5247-482c-bd0c-18a73a19cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.092077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1159/2332] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:15 2022] DELETE /identity/v3/users/1b08186378344d5d824d6d25e60de813 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:16.098562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c28251-1b14-4785-b149-18b9ed856cbc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.099021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c28251-1b14-4785-b149-18b9ed856cbc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.099588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c28251-1b14-4785-b149-18b9ed856cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.101737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ed626bf2-5247-482c-bd0c-18a73a19cf5b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:16.104369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ed626bf2-5247-482c-bd0c-18a73a19cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:16.126262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-07c28251-1b14-4785-b149-18b9ed856cbc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:16.127960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-07c28251-1b14-4785-b149-18b9ed856cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:16.225013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1160/2333] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:16.233835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1174/2334] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:03:16.239514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c28251-1b14-4785-b149-18b9ed856cbc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:16.243561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-07c28251-1b14-4785-b149-18b9ed856cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:16.246138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed626bf2-5247-482c-bd0c-18a73a19cf5b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:16.268575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed626bf2-5247-482c-bd0c-18a73a19cf5b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:16.285065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:16.285594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.286162 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.286512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.287547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:03:16.287928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:16.290682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:16.306959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1175/2335] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:03:16.314283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:16.328616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78219-8aec-4ee2-a07c-939ca1e196db admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:16.334094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d316319-48cf-44d7-931a-e54f7de2fb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:16.337268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d316319-48cf-44d7-931a-e54f7de2fb9d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.337268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d316319-48cf-44d7-931a-e54f7de2fb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.337268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d316319-48cf-44d7-931a-e54f7de2fb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.337268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d316319-48cf-44d7-931a-e54f7de2fb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:16.338193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d316319-48cf-44d7-931a-e54f7de2fb9d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:16.338820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c28251-1b14-4785-b149-18b9ed856cbc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:16.343276 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b690752-e4ac-446c-b5e9-61fb47ccaa8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:16.344093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690752-e4ac-446c-b5e9-61fb47ccaa8e service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.344447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690752-e4ac-446c-b5e9-61fb47ccaa8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.344794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690752-e4ac-446c-b5e9-61fb47ccaa8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.355302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b690752-e4ac-446c-b5e9-61fb47ccaa8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:16.359582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b690752-e4ac-446c-b5e9-61fb47ccaa8e service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:16.372690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1161/2336] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:16.442089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1176/2337] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:03:16 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:03:16.445980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b690752-e4ac-446c-b5e9-61fb47ccaa8e service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:16.459259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b690752-e4ac-446c-b5e9-61fb47ccaa8e service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:16.553781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203291-96aa-4609-81f9-97963c21d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:16.554571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203291-96aa-4609-81f9-97963c21d336 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.554887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203291-96aa-4609-81f9-97963c21d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.555588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203291-96aa-4609-81f9-97963c21d336 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.556151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7203291-96aa-4609-81f9-97963c21d336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:16.558452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7203291-96aa-4609-81f9-97963c21d336 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:16.679465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1162/2338] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:03:16 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:03:16.684106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d316319-48cf-44d7-931a-e54f7de2fb9d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:16.703838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d316319-48cf-44d7-931a-e54f7de2fb9d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:16.722818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019079-460d-4810-a71b-5938c2fcee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:16.723624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019079-460d-4810-a71b-5938c2fcee26 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.723908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019079-460d-4810-a71b-5938c2fcee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.724308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1019079-460d-4810-a71b-5938c2fcee26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.725067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019079-460d-4810-a71b-5938c2fcee26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:16.726993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1019079-460d-4810-a71b-5938c2fcee26 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:16.742204 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1177/2339] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:03:16.747048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203291-96aa-4609-81f9-97963c21d336 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:16.758723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203291-96aa-4609-81f9-97963c21d336 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:16.766346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44ef41-6f6f-45f5-b910-00e9a94c85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:16.767482 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ef41-6f6f-45f5-b910-00e9a94c85e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.767973 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ef41-6f6f-45f5-b910-00e9a94c85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.768455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44ef41-6f6f-45f5-b910-00e9a94c85e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.769719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44ef41-6f6f-45f5-b910-00e9a94c85e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:16.773104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44ef41-6f6f-45f5-b910-00e9a94c85e4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:16.802028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1163/2340] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:03:16.803552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019079-460d-4810-a71b-5938c2fcee26 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:16.817871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1019079-460d-4810-a71b-5938c2fcee26 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:16.831199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:16.832114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:16.832412 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:16.832677 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] PATH_INFO: `/v3/projects/17c8da099e7147b3ac92a967507e5055/users/00dd62328d434a8ebf0a458dc096007f/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:16.853652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c8da099e7147b3ac92a967507e5055, user_id=00dd62328d434a8ebf0a458dc096007f, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:16.856867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:16.986657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1178/2341] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:03:16 2022] PUT /identity/v3/projects/17c8da099e7147b3ac92a967507e5055/users/00dd62328d434a8ebf0a458dc096007f/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:17.000139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db46a29-bf89-4f3e-8dad-17e73dc93d3f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:17.000433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db46a29-bf89-4f3e-8dad-17e73dc93d3f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:17.000720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db46a29-bf89-4f3e-8dad-17e73dc93d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:17.032076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4db46a29-bf89-4f3e-8dad-17e73dc93d3f None None] MFA Rules not processed for user `00dd62328d434a8ebf0a458dc096007f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:17.033779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4db46a29-bf89-4f3e-8dad-17e73dc93d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:17.061839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:17.064673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:17.127741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1164/2342] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:17.133293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db46a29-bf89-4f3e-8dad-17e73dc93d3f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:17.142256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5e819-a17f-42fe-b6c5-f06d61f894ec admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:17.145597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db46a29-bf89-4f3e-8dad-17e73dc93d3f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:17.147758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:17.148757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:17.149041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:17.149303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] PATH_INFO: `/v3/projects/8f42c2bc59f44516848a6eee3e1b207e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:17.151010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c0251-d9f0-4db6-96d3-9e8a27a7dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:17.151248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f42c2bc59f44516848a6eee3e1b207e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:17.151802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0251-d9f0-4db6-96d3-9e8a27a7dfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:17.152157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0251-d9f0-4db6-96d3-9e8a27a7dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:17.152498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0251-d9f0-4db6-96d3-9e8a27a7dfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:17.153170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:17.153296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c0251-d9f0-4db6-96d3-9e8a27a7dfd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:17.155917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c0251-d9f0-4db6-96d3-9e8a27a7dfd7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:17.257461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1165/2343] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:03:17 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:03:17.263414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c0251-d9f0-4db6-96d3-9e8a27a7dfd7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:17.325956 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f42c2bc59f44516848a6eee3e1b207e', 'request_id': 'req-19a5b5d3-7a46-4762-ab85-adec63392376'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:17.339089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f42c2bc59f44516848a6eee3e1b207e', 'request_id': 'req-19a5b5d3-7a46-4762-ab85-adec63392376'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:17.351442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f42c2bc59f44516848a6eee3e1b207e', 'request_id': 'req-19a5b5d3-7a46-4762-ab85-adec63392376'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:17.364621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c0251-d9f0-4db6-96d3-9e8a27a7dfd7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:17.431451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bb562-42d2-469d-a88f-b999d1ddbf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:17.432320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bb562-42d2-469d-a88f-b999d1ddbf02 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:17.432689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bb562-42d2-469d-a88f-b999d1ddbf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:17.433163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bb562-42d2-469d-a88f-b999d1ddbf02 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:17.434089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bb562-42d2-469d-a88f-b999d1ddbf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:17.438605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bb562-42d2-469d-a88f-b999d1ddbf02 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:17.478845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] The token cache is being invalidate because project 8f42c2bc59f44516848a6eee3e1b207e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:17.478845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:17.478845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:17.478845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1179/2344] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:17 2022] DELETE /identity/v3/projects/8f42c2bc59f44516848a6eee3e1b207e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:17.558329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1166/2345] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:03:17 2022] POST /identity/v3/users => generated 297 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:03:17.563889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:17.565504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:17.585215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5b5d3-7a46-4762-ab85-adec63392376 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:17.591991 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aebb3e-cd34-4b16-a105-d8437aa8fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:17.592903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aebb3e-cd34-4b16-a105-d8437aa8fab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:17.593266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aebb3e-cd34-4b16-a105-d8437aa8fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:17.593757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aebb3e-cd34-4b16-a105-d8437aa8fab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:17.594720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aebb3e-cd34-4b16-a105-d8437aa8fab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:17.596627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aebb3e-cd34-4b16-a105-d8437aa8fab8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:17.626282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bb562-42d2-469d-a88f-b999d1ddbf02 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:17.632487 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1180/2346] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:03:17.642566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bb562-42d2-469d-a88f-b999d1ddbf02 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:17.652909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fae6c2-47ca-4462-abfc-36f214b9364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:17.654932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae6c2-47ca-4462-abfc-36f214b9364c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:17.655401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae6c2-47ca-4462-abfc-36f214b9364c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:17.656052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fae6c2-47ca-4462-abfc-36f214b9364c admin admin] PATH_INFO: `/v3/projects/f6c16a5a08a44055845d15579f5af129/users/4eac25a542be4e2990a5b685030ad1af/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:17.677313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fae6c2-47ca-4462-abfc-36f214b9364c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c16a5a08a44055845d15579f5af129, user_id=4eac25a542be4e2990a5b685030ad1af, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:17.680721 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fae6c2-47ca-4462-abfc-36f214b9364c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:17.912130 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1167/2347] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:03:17 2022] PUT /identity/v3/projects/f6c16a5a08a44055845d15579f5af129/users/4eac25a542be4e2990a5b685030ad1af/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:17.916323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aebb3e-cd34-4b16-a105-d8437aa8fab8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:17.927508 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aebb3e-cd34-4b16-a105-d8437aa8fab8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:17.989884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477daf30-c8b8-4a3a-8cf8-256811dec2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:17.990717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477daf30-c8b8-4a3a-8cf8-256811dec2db admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:17.991004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477daf30-c8b8-4a3a-8cf8-256811dec2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:17.991288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477daf30-c8b8-4a3a-8cf8-256811dec2db admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:17.992022 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477daf30-c8b8-4a3a-8cf8-256811dec2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:17.993623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477daf30-c8b8-4a3a-8cf8-256811dec2db admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:18.005175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1181/2348] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:03:18.009437 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fae6c2-47ca-4462-abfc-36f214b9364c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:18.019764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fae6c2-47ca-4462-abfc-36f214b9364c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:18.024480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:18.025338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:18.025623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:18.025901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] PATH_INFO: `/v3/projects/f6c16a5a08a44055845d15579f5af129/users/4eac25a542be4e2990a5b685030ad1af/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:18.027910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c16a5a08a44055845d15579f5af129, user_id=4eac25a542be4e2990a5b685030ad1af, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:18.030616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:18.041193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1168/2349] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:03:18 2022] PUT /identity/v3/projects/f6c16a5a08a44055845d15579f5af129/users/4eac25a542be4e2990a5b685030ad1af/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:18.053554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeef6c-af57-404f-b0dc-61e8625b9486 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:18.053852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeef6c-af57-404f-b0dc-61e8625b9486 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:18.054175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeef6c-af57-404f-b0dc-61e8625b9486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:18.085074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a2eeef6c-af57-404f-b0dc-61e8625b9486 None None] MFA Rules not processed for user `4eac25a542be4e2990a5b685030ad1af`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:18.086371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a2eeef6c-af57-404f-b0dc-61e8625b9486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:18.158843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1182/2350] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:18.171160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:18.173231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:18.234676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe62028-e03d-416d-a4f3-0b21eca5af48 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:18.238657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a16f4-3222-4049-ac1a-46ad502bcb19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:18.239299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a16f4-3222-4049-ac1a-46ad502bcb19 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:18.239613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a16f4-3222-4049-ac1a-46ad502bcb19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:18.239891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a16f4-3222-4049-ac1a-46ad502bcb19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:18.249677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a16f4-3222-4049-ac1a-46ad502bcb19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:18.251158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a16f4-3222-4049-ac1a-46ad502bcb19 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:18.263698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1169/2351] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:18.481113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeef6c-af57-404f-b0dc-61e8625b9486 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:18.492575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeef6c-af57-404f-b0dc-61e8625b9486 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:18.496266 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0fcc1-4da2-4573-a10a-632d8247408e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:18.496907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0fcc1-4da2-4573-a10a-632d8247408e service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:18.497531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0fcc1-4da2-4573-a10a-632d8247408e service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:18.497531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0fcc1-4da2-4573-a10a-632d8247408e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:18.500255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-61e0fcc1-4da2-4573-a10a-632d8247408e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:18.541292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:18.578820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0fcc1-4da2-4573-a10a-632d8247408e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:18.580028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0fcc1-4da2-4573-a10a-632d8247408e service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:18.592295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1183/2352] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:03:19.243199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a16f4-3222-4049-ac1a-46ad502bcb19 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:19.321034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a16f4-3222-4049-ac1a-46ad502bcb19 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:19.326165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:19.327179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:19.327463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:19.327739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] PATH_INFO: `/v3/users/00dd62328d434a8ebf0a458dc096007f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:19.329001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00dd62328d434a8ebf0a458dc096007f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:19.331013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:19.443565 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:19.695146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00dd62328d434a8ebf0a458dc096007f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:19.695807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00dd62328d434a8ebf0a458dc096007f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:19.704272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00dd62328d434a8ebf0a458dc096007f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:19.705542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00dd62328d434a8ebf0a458dc096007f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:19.832373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00dd62328d434a8ebf0a458dc096007f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:19.863428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1170/2353] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:19 2022] DELETE /identity/v3/users/00dd62328d434a8ebf0a458dc096007f => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:19.867781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608df221-b164-4eaf-b46b-f9d7a1bd16ea None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:19.868284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608df221-b164-4eaf-b46b-f9d7a1bd16ea None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:19.868364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608df221-b164-4eaf-b46b-f9d7a1bd16ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:19.910028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-608df221-b164-4eaf-b46b-f9d7a1bd16ea None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:19.911874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-608df221-b164-4eaf-b46b-f9d7a1bd16ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:20.007096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1184/2354] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:20.017489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:20.019958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:20.086770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a76b8-bc75-4ee5-8ccd-bfb2573abb5d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:20.090423 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642294db-d392-462c-a86b-50db6f7d53b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:20.091068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642294db-d392-462c-a86b-50db6f7d53b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:20.091347 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642294db-d392-462c-a86b-50db6f7d53b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:20.091619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642294db-d392-462c-a86b-50db6f7d53b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:20.101777 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642294db-d392-462c-a86b-50db6f7d53b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:20.103326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642294db-d392-462c-a86b-50db6f7d53b3 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:20.113698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1171/2355] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:20.730302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608df221-b164-4eaf-b46b-f9d7a1bd16ea None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:20.732107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-608df221-b164-4eaf-b46b-f9d7a1bd16ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:20.746428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608df221-b164-4eaf-b46b-f9d7a1bd16ea None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:20.753449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:20.761589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:20.761589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:20.761589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] PATH_INFO: `/v3/projects/17c8da099e7147b3ac92a967507e5055` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:20.761589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c8da099e7147b3ac92a967507e5055)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:20.761589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:20.939718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c8da099e7147b3ac92a967507e5055', 'request_id': 'req-e08fea4a-b345-4696-b94d-99eaaeec8184'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:20.946632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c8da099e7147b3ac92a967507e5055', 'request_id': 'req-e08fea4a-b345-4696-b94d-99eaaeec8184'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:20.952892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c8da099e7147b3ac92a967507e5055', 'request_id': 'req-e08fea4a-b345-4696-b94d-99eaaeec8184'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:21.071758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] The token cache is being invalidate because project 17c8da099e7147b3ac92a967507e5055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:21.072981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:21.074102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:21.077750 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1185/2356] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:20 2022] DELETE /identity/v3/projects/17c8da099e7147b3ac92a967507e5055 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:21.081172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642294db-d392-462c-a86b-50db6f7d53b3 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:21.102630 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642294db-d392-462c-a86b-50db6f7d53b3 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:21.200998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:21.218204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:21.218204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:21.218204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] PATH_INFO: `/v3/users/4eac25a542be4e2990a5b685030ad1af` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:21.218204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eac25a542be4e2990a5b685030ad1af)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:21.218204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:21.530294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eac25a542be4e2990a5b685030ad1af'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:21.533585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eac25a542be4e2990a5b685030ad1af'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:21.542393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eac25a542be4e2990a5b685030ad1af'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:21.543821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eac25a542be4e2990a5b685030ad1af'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:21.659779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eac25a542be4e2990a5b685030ad1af'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:21.690884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1172/2357] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:21 2022] DELETE /identity/v3/users/4eac25a542be4e2990a5b685030ad1af => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:22.738751 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:22.741462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:22.755441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fea4a-b345-4696-b94d-99eaaeec8184 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:22.840474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:22.841669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:22.842967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:22.843086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] PATH_INFO: `/v3/projects/f6c16a5a08a44055845d15579f5af129` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:22.844386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c16a5a08a44055845d15579f5af129)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:22.846788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:22.970820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c16a5a08a44055845d15579f5af129', 'request_id': 'req-685464de-61b5-4d94-82fd-1d4ff5ad4f06'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:22.977219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c16a5a08a44055845d15579f5af129', 'request_id': 'req-685464de-61b5-4d94-82fd-1d4ff5ad4f06'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:22.983362 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c16a5a08a44055845d15579f5af129', 'request_id': 'req-685464de-61b5-4d94-82fd-1d4ff5ad4f06'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:23.122539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] The token cache is being invalidate because project f6c16a5a08a44055845d15579f5af129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:23.122766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:23.129208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:23.130326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1186/2358] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:22 2022] DELETE /identity/v3/projects/f6c16a5a08a44055845d15579f5af129 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:23.271769 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:25.111840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:27.567297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:28.139879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:29.585684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:30.893718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:30.996363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:32.705294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:32.812763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:33.219840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:33.722516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:34.029779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:34.539165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:35.132199 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:35.522650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:35.734370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:36.252061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:36.305264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:36.566765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:37.052323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:37.463808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:37.715413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:38.252091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:38.355636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:38.785072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:38.921925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:39.688373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:40.161834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:40.641892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:40.913950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:40.915501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:41.009829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3bf5-6e80-437b-84b8-e90f2a901a10 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:41.069191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4f2c6-0138-4ca0-bf47-426deee95c47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:41.069840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4f2c6-0138-4ca0-bf47-426deee95c47 service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:41.070155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4f2c6-0138-4ca0-bf47-426deee95c47 service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:41.070435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4f2c6-0138-4ca0-bf47-426deee95c47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:41.072176 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-98d4f2c6-0138-4ca0-bf47-426deee95c47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:41.083355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:41.085676 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4f2c6-0138-4ca0-bf47-426deee95c47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:41.087384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4f2c6-0138-4ca0-bf47-426deee95c47 service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:41.098278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1173/2359] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:41.435293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:41.710720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:41.797069 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:42.554799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:42.699617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:42.983907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:43.000591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:43.002284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:43.023177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:43.069682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685464de-61b5-4d94-82fd-1d4ff5ad4f06 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:43.075371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:43.076898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:43.077262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:43.077620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:43.079763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:43.149546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:43.151398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:43.162724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1187/2360] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:43.384023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:43.475405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:43.812143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:44.075892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:44.229193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:44.619790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:44.751124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:44.859772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:44.985385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:45.127655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:45.196344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:45.396501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:45.502162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:45.653866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:45.813689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:45.951411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:45.973600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.065271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.188446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.292373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.391045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.636498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.741590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.767985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.893251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:46.961874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:47.031242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:47.065129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:47.226051 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:47.357755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:47.516373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:47.613446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:47.674757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:47.824271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:49.037154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709902a-4aaf-4733-aaeb-8ef365d9296a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:49.037713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709902a-4aaf-4733-aaeb-8ef365d9296a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:49.037713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709902a-4aaf-4733-aaeb-8ef365d9296a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:49.096774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b709902a-4aaf-4733-aaeb-8ef365d9296a None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:49.097986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b709902a-4aaf-4733-aaeb-8ef365d9296a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:49.170410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1174/2361] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:03:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:49.211476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:49.212904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:49.308477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d67db-294f-4974-8a33-14670caa3d19 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:49.314038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6eb21-e256-4488-a9d9-ddedd4073a86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:49.314826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6eb21-e256-4488-a9d9-ddedd4073a86 service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:49.315111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6eb21-e256-4488-a9d9-ddedd4073a86 service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:49.315387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6eb21-e256-4488-a9d9-ddedd4073a86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:49.321797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:49.324019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6eb21-e256-4488-a9d9-ddedd4073a86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:49.325729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6eb21-e256-4488-a9d9-ddedd4073a86 service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:49.334206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1188/2362] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:03:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:03:56.970986 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709902a-4aaf-4733-aaeb-8ef365d9296a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:56.972655 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b709902a-4aaf-4733-aaeb-8ef365d9296a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:57.051782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:03:57.056332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709902a-4aaf-4733-aaeb-8ef365d9296a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:57.064562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:57.067082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:57.067082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:57.067082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] PATH_INFO: `/v3/users/9066c93bba054b058b4fa5f104392958` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:57.069087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9066c93bba054b058b4fa5f104392958)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:57.071363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:57.308726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9066c93bba054b058b4fa5f104392958'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:57.309308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9066c93bba054b058b4fa5f104392958'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:57.320024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9066c93bba054b058b4fa5f104392958'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:57.321595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9066c93bba054b058b4fa5f104392958'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:57.414007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9066c93bba054b058b4fa5f104392958'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:57.438512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1175/2363] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:03:56 2022] DELETE /identity/v3/users/9066c93bba054b058b4fa5f104392958 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:03:57.444799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704c55-f750-4aa8-96ef-f660f4c86ffe None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:57.445778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704c55-f750-4aa8-96ef-f660f4c86ffe None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:57.446678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704c55-f750-4aa8-96ef-f660f4c86ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:57.467963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-09704c55-f750-4aa8-96ef-f660f4c86ffe None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:03:57.469513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-09704c55-f750-4aa8-96ef-f660f4c86ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:57.554540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1189/2364] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:03:57.561005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:57.562342 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:57.651211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b82aec-acb4-479c-8253-a5462d911732 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:57.657240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106bb67-8eb8-4b50-b6e5-32155ca6bb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:57.657850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bb67-8eb8-4b50-b6e5-32155ca6bb14 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:57.658169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bb67-8eb8-4b50-b6e5-32155ca6bb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:57.658604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106bb67-8eb8-4b50-b6e5-32155ca6bb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:57.681493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106bb67-8eb8-4b50-b6e5-32155ca6bb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:57.683703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106bb67-8eb8-4b50-b6e5-32155ca6bb14 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:57.713651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1176/2365] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:03:58.292462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704c55-f750-4aa8-96ef-f660f4c86ffe None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:03:58.295110 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-09704c55-f750-4aa8-96ef-f660f4c86ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:03:58.313791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704c55-f750-4aa8-96ef-f660f4c86ffe None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:03:58.322884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:03:58.324821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:03:58.326794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:03:58.328133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] PATH_INFO: `/v3/projects/cb1919e3e2b741ef8289d4be1d60acb5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:03:58.331775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1919e3e2b741ef8289d4be1d60acb5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:03:58.336586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:03:58.487824 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1919e3e2b741ef8289d4be1d60acb5', 'request_id': 'req-867e7355-c8e1-4ad0-833a-3f9cae18825c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:58.495553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1919e3e2b741ef8289d4be1d60acb5', 'request_id': 'req-867e7355-c8e1-4ad0-833a-3f9cae18825c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:58.505567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1919e3e2b741ef8289d4be1d60acb5', 'request_id': 'req-867e7355-c8e1-4ad0-833a-3f9cae18825c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:58.609558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] The token cache is being invalidate because project cb1919e3e2b741ef8289d4be1d60acb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:03:58.609914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:58.610804 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:03:58.612708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1190/2366] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:03:58 2022] DELETE /identity/v3/projects/cb1919e3e2b741ef8289d4be1d60acb5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:04:07.232129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d07be-bbd2-461e-96a5-0ba16770c656 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:07.232998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d07be-bbd2-461e-96a5-0ba16770c656 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:07.233110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d07be-bbd2-461e-96a5-0ba16770c656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:07.253837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d34d07be-bbd2-461e-96a5-0ba16770c656 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:07.255137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d34d07be-bbd2-461e-96a5-0ba16770c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:07.325683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1177/2367] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 22 09:04:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:07.338977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:07.340762 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:07.416955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e7355-c8e1-4ad0-833a-3f9cae18825c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:07.423287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfe238-a95a-47e1-a6b3-1f72d5815d5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:07.423942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe238-a95a-47e1-a6b3-1f72d5815d5d service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:07.424223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe238-a95a-47e1-a6b3-1f72d5815d5d service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:07.424499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe238-a95a-47e1-a6b3-1f72d5815d5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:07.433649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfe238-a95a-47e1-a6b3-1f72d5815d5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:07.439612 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfe238-a95a-47e1-a6b3-1f72d5815d5d service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:07.444875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1191/2368] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:04:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:04:10.979280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d07be-bbd2-461e-96a5-0ba16770c656 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:10.979280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d34d07be-bbd2-461e-96a5-0ba16770c656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:11.015571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:11.059634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d07be-bbd2-461e-96a5-0ba16770c656 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:11.064672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:11.065650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:11.065933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:11.066241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] PATH_INFO: `/v3/users/e4eae42e04bd49ecae3fd63cd5b52a43` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:11.067570 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4eae42e04bd49ecae3fd63cd5b52a43)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:11.069627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:11.285607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4eae42e04bd49ecae3fd63cd5b52a43'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:11.286340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4eae42e04bd49ecae3fd63cd5b52a43'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:11.293852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4eae42e04bd49ecae3fd63cd5b52a43'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:11.294585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4eae42e04bd49ecae3fd63cd5b52a43'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:11.383127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-f6920617-a3d5-400c-a090-6551bc175795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4eae42e04bd49ecae3fd63cd5b52a43'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:11.406251 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1178/2369] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:04:10 2022] DELETE /identity/v3/users/e4eae42e04bd49ecae3fd63cd5b52a43 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:04:11.671409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfe238-a95a-47e1-a6b3-1f72d5815d5d service swift] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:11.684188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfe238-a95a-47e1-a6b3-1f72d5815d5d service swift] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:11.689594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:11.754490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:11.755379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:11.755661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:11.755936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] PATH_INFO: `/v3/projects/9beb16c610a94371b896183858e4c1d5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:11.757226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9beb16c610a94371b896183858e4c1d5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:11.759233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:11.872589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9beb16c610a94371b896183858e4c1d5', 'request_id': 'req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:11.880316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9beb16c610a94371b896183858e4c1d5', 'request_id': 'req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:11.887858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9beb16c610a94371b896183858e4c1d5', 'request_id': 'req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:12.013156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] The token cache is being invalidate because project 9beb16c610a94371b896183858e4c1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:04:12.013682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:12.014843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6c8e17-2199-49f2-a4f2-0af4e8ababcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:04:12.016673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1192/2370] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:04:11 2022] DELETE /identity/v3/projects/9beb16c610a94371b896183858e4c1d5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:04:12.021758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf6c7-ff57-4688-bf1f-1073af04370b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.022324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf6c7-ff57-4688-bf1f-1073af04370b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.022414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf6c7-ff57-4688-bf1f-1073af04370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.043220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f5ebf6c7-ff57-4688-bf1f-1073af04370b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:12.044471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f5ebf6c7-ff57-4688-bf1f-1073af04370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:12.134466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1179/2371] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:12.139329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cc6e6-8213-452a-b605-c2d639ee6309 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.139611 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cc6e6-8213-452a-b605-c2d639ee6309 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.139887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cc6e6-8213-452a-b605-c2d639ee6309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.159024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-528cc6e6-8213-452a-b605-c2d639ee6309 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:12.164873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-528cc6e6-8213-452a-b605-c2d639ee6309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:12.167872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1193/2372] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:12.172886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf6c7-ff57-4688-bf1f-1073af04370b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:12.183268 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf6c7-ff57-4688-bf1f-1073af04370b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:12.188028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:12.188696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.188984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.189259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.189992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:04:12.190341 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:12.191943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:12.204425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1180/2373] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:04:12.209489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cc6e6-8213-452a-b605-c2d639ee6309 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:12.220426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cc6e6-8213-452a-b605-c2d639ee6309 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:12.225331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707526-a129-4eab-beed-44b90a65361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:12.226021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707526-a129-4eab-beed-44b90a65361e admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.226409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707526-a129-4eab-beed-44b90a65361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.226730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea707526-a129-4eab-beed-44b90a65361e admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.227423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea707526-a129-4eab-beed-44b90a65361e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:12.229382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea707526-a129-4eab-beed-44b90a65361e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:12.333989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1194/2374] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:04:12 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:04:12.338000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:12.349222 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a400eb-d020-4204-92f7-8c787404b6f9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:12.382246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:12.412728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e277-f757-4e91-a0cb-c43b0de7f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:12.413550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e277-f757-4e91-a0cb-c43b0de7f237 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.413840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e277-f757-4e91-a0cb-c43b0de7f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.414150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e277-f757-4e91-a0cb-c43b0de7f237 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.414945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e277-f757-4e91-a0cb-c43b0de7f237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:12.416876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e277-f757-4e91-a0cb-c43b0de7f237 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:12.532469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1181/2375] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:04:12 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:04:12.537154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707526-a129-4eab-beed-44b90a65361e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:12.548757 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea707526-a129-4eab-beed-44b90a65361e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:12.554127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973132d8-73a1-416c-b691-b708f6b7044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:12.554892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973132d8-73a1-416c-b691-b708f6b7044d admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.555131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973132d8-73a1-416c-b691-b708f6b7044d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.555382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973132d8-73a1-416c-b691-b708f6b7044d admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.556137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973132d8-73a1-416c-b691-b708f6b7044d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:12.557765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973132d8-73a1-416c-b691-b708f6b7044d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:12.569650 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1195/2376] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:04:12.574412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e277-f757-4e91-a0cb-c43b0de7f237 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:12.589039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e277-f757-4e91-a0cb-c43b0de7f237 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:12.595236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2151e-715f-4996-90d6-53b83d1e0bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:12.595897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2151e-715f-4996-90d6-53b83d1e0bce admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.596177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2151e-715f-4996-90d6-53b83d1e0bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.596452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2151e-715f-4996-90d6-53b83d1e0bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.597330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2151e-715f-4996-90d6-53b83d1e0bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:12.599001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2151e-715f-4996-90d6-53b83d1e0bce admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:12.611549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1182/2377] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:04:12.616072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973132d8-73a1-416c-b691-b708f6b7044d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:12.627732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973132d8-73a1-416c-b691-b708f6b7044d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:12.632565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:12.633471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.633746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.634532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] PATH_INFO: `/v3/projects/85bf3e1b89094cafa7d469ed3f84eb36/users/448ee30440fb46779216649dd6907331/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.652554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bf3e1b89094cafa7d469ed3f84eb36, user_id=448ee30440fb46779216649dd6907331, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:12.655259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:12.798613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1196/2378] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:04:12 2022] PUT /identity/v3/projects/85bf3e1b89094cafa7d469ed3f84eb36/users/448ee30440fb46779216649dd6907331/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:04:12.803821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d52df-0260-4422-94d9-d32039a837c7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.804145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d52df-0260-4422-94d9-d32039a837c7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.804435 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d52df-0260-4422-94d9-d32039a837c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.822974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9f3d52df-0260-4422-94d9-d32039a837c7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:12.824229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9f3d52df-0260-4422-94d9-d32039a837c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:12.896256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1183/2379] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:12.907798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:12.909529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:12.948772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:12.974878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d9b2-ca2c-4c53-8da3-95ec7b7dbbeb admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:12.979165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9965a0-6ca8-4c4c-bf99-e3102efffe17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:12.980087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9965a0-6ca8-4c4c-bf99-e3102efffe17 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:12.980404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9965a0-6ca8-4c4c-bf99-e3102efffe17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:12.980657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9965a0-6ca8-4c4c-bf99-e3102efffe17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:12.996910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9965a0-6ca8-4c4c-bf99-e3102efffe17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:12.998520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9965a0-6ca8-4c4c-bf99-e3102efffe17 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:13.009589 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1197/2380] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:18.941821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14665e-c565-4b14-942b-b46c928c3be2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:18.942826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14665e-c565-4b14-942b-b46c928c3be2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:18.944357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14665e-c565-4b14-942b-b46c928c3be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:18.975807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-eb14665e-c565-4b14-942b-b46c928c3be2 None None] MFA Rules not processed for user `448ee30440fb46779216649dd6907331`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:18.977926 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-eb14665e-c565-4b14-942b-b46c928c3be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:19.059967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1184/2381] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:04:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:19.065196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9965a0-6ca8-4c4c-bf99-e3102efffe17 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:19.075640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9965a0-6ca8-4c4c-bf99-e3102efffe17 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:19.081582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6d71-c9c5-454b-b1c1-3021f6054a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:19.082576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6d71-c9c5-454b-b1c1-3021f6054a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:19.082937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6d71-c9c5-454b-b1c1-3021f6054a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:19.083287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c6d71-c9c5-454b-b1c1-3021f6054a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:19.084092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c6d71-c9c5-454b-b1c1-3021f6054a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:19.086303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c6d71-c9c5-454b-b1c1-3021f6054a9b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:19.204007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1198/2382] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:04:19 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:04:19.208108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14665e-c565-4b14-942b-b46c928c3be2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:19.222579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14665e-c565-4b14-942b-b46c928c3be2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:19.273726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:19.293591 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a429dbe-6da7-4f50-aeb5-2e35059585a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:19.294345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a429dbe-6da7-4f50-aeb5-2e35059585a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:19.294633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a429dbe-6da7-4f50-aeb5-2e35059585a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:19.295573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a429dbe-6da7-4f50-aeb5-2e35059585a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:19.296489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a429dbe-6da7-4f50-aeb5-2e35059585a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:19.298516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a429dbe-6da7-4f50-aeb5-2e35059585a9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:19.471271 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1185/2383] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:04:19 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:04:19.475586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6d71-c9c5-454b-b1c1-3021f6054a9b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:19.487068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c6d71-c9c5-454b-b1c1-3021f6054a9b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:19.491809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb384c-3c91-42ad-a216-926fd4dc8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:19.495301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb384c-3c91-42ad-a216-926fd4dc8b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:19.495301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb384c-3c91-42ad-a216-926fd4dc8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:19.495301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb384c-3c91-42ad-a216-926fd4dc8b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:19.495301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb384c-3c91-42ad-a216-926fd4dc8b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:19.495728 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb384c-3c91-42ad-a216-926fd4dc8b39 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:19.507561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1199/2384] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:04:19.513033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a429dbe-6da7-4f50-aeb5-2e35059585a9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:19.530146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a429dbe-6da7-4f50-aeb5-2e35059585a9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:19.533943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c658d2-96e1-4d60-9f5b-cedc85ddf8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:19.534895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c658d2-96e1-4d60-9f5b-cedc85ddf8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:19.535522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c658d2-96e1-4d60-9f5b-cedc85ddf8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:19.535522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c658d2-96e1-4d60-9f5b-cedc85ddf8b7 admin admin] PATH_INFO: `/v3/projects/9b310263a3924f8a90aef181ca42abc5/users/1437edad22b64921a4a4998a98a2a4e1/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:19.552094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c658d2-96e1-4d60-9f5b-cedc85ddf8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b310263a3924f8a90aef181ca42abc5, user_id=1437edad22b64921a4a4998a98a2a4e1, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:19.554957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c658d2-96e1-4d60-9f5b-cedc85ddf8b7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:19.717747 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1186/2385] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:04:19 2022] PUT /identity/v3/projects/9b310263a3924f8a90aef181ca42abc5/users/1437edad22b64921a4a4998a98a2a4e1/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:04:19.726131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb384c-3c91-42ad-a216-926fd4dc8b39 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:19.737137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb384c-3c91-42ad-a216-926fd4dc8b39 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:19.814827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e7918-0322-4c12-9643-87de41a37e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:19.815512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7918-0322-4c12-9643-87de41a37e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:19.815791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7918-0322-4c12-9643-87de41a37e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:19.816063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e7918-0322-4c12-9643-87de41a37e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:19.816820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e7918-0322-4c12-9643-87de41a37e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:19.818438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e7918-0322-4c12-9643-87de41a37e81 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:19.830917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1200/2386] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:04:19.835576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c658d2-96e1-4d60-9f5b-cedc85ddf8b7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:19.850246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c658d2-96e1-4d60-9f5b-cedc85ddf8b7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:19.856029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:19.857028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:19.858029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:19.858405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] PATH_INFO: `/v3/projects/9b310263a3924f8a90aef181ca42abc5/users/1437edad22b64921a4a4998a98a2a4e1/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:19.860510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b310263a3924f8a90aef181ca42abc5, user_id=1437edad22b64921a4a4998a98a2a4e1, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:19.864846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:19.876893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1187/2387] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:04:19 2022] PUT /identity/v3/projects/9b310263a3924f8a90aef181ca42abc5/users/1437edad22b64921a4a4998a98a2a4e1/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:04:27.426998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a719b-fa3e-48f2-9e5b-6be6a310f9c3 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:27.428004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a719b-fa3e-48f2-9e5b-6be6a310f9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:27.428296 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a719b-fa3e-48f2-9e5b-6be6a310f9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:27.463915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ae5a719b-fa3e-48f2-9e5b-6be6a310f9c3 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:27.465177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ae5a719b-fa3e-48f2-9e5b-6be6a310f9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:27.579314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1201/2388] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:04:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:27.604609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:27.606850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:27.771492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c192-7f7a-4f45-b8d6-744b83bccdf8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:27.783208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:27.785284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:27.785965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:27.787965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:27.805808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:27.808783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:27.831880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1188/2389] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:04:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:04:28.105555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa89fa-d4cc-494f-9e20-6de68d67b8f1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:28.106459 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa89fa-d4cc-494f-9e20-6de68d67b8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:28.106994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa89fa-d4cc-494f-9e20-6de68d67b8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:28.136983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-cfaa89fa-d4cc-494f-9e20-6de68d67b8f1 None None] MFA Rules not processed for user `1437edad22b64921a4a4998a98a2a4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:28.138240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cfaa89fa-d4cc-494f-9e20-6de68d67b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:28.192124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:28.250198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1202/2390] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:04:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:28.265513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:28.267305 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:28.400448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5276b-9015-4f7a-beef-dfb1dd7079f4 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:28.406231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d039e5-fae2-487a-a57f-b102c4bc0898 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb36ac7a2e4643009bc1b0ca599203f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:28.406978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d039e5-fae2-487a-a57f-b102c4bc0898 service glance] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:28.407357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d039e5-fae2-487a-a57f-b102c4bc0898 service glance] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:28.407709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d039e5-fae2-487a-a57f-b102c4bc0898 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:28.426093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:28.510524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d039e5-fae2-487a-a57f-b102c4bc0898 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:28.510524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d039e5-fae2-487a-a57f-b102c4bc0898 service glance] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:28.530247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1189/2391] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:28.814713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d9e6-544e-44e0-9a51-be43a777702c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:28.815215 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d9e6-544e-44e0-9a51-be43a777702c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:28.815297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1d9e6-544e-44e0-9a51-be43a777702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:28.854729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f3e1d9e6-544e-44e0-9a51-be43a777702c None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:28.858469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f3e1d9e6-544e-44e0-9a51-be43a777702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:28.868335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1203/2392] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:04:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:28.904155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d039e5-fae2-487a-a57f-b102c4bc0898 service glance] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:28.923792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d039e5-fae2-487a-a57f-b102c4bc0898 service glance] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:28.948428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e97d4b-59ea-492f-a602-8f272b5d7b8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:28.949247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e97d4b-59ea-492f-a602-8f272b5d7b8a service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:28.949647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e97d4b-59ea-492f-a602-8f272b5d7b8a service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:28.950023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e97d4b-59ea-492f-a602-8f272b5d7b8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:28.980087 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e97d4b-59ea-492f-a602-8f272b5d7b8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:28.983750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e97d4b-59ea-492f-a602-8f272b5d7b8a service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:29.008895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1190/2393] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:04:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:04:38.851694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=17 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:38.993863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=26 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:04:45.885228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fa543-2c20-472c-b0d1-d35e8d27db68 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:45.885835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fa543-2c20-472c-b0d1-d35e8d27db68 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:45.885835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fa543-2c20-472c-b0d1-d35e8d27db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:45.904913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b59fa543-2c20-472c-b0d1-d35e8d27db68 None None] MFA Rules not processed for user `448ee30440fb46779216649dd6907331`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:45.906156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b59fa543-2c20-472c-b0d1-d35e8d27db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:45.913268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1204/2394] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:04:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:04:46.393025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81ecb-1208-4e6b-b3dc-694fbc3749b8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:46.393632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81ecb-1208-4e6b-b3dc-694fbc3749b8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:46.393632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81ecb-1208-4e6b-b3dc-694fbc3749b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:46.416765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cbc81ecb-1208-4e6b-b3dc-694fbc3749b8 None None] MFA Rules not processed for user `cf981e5982644d708ddaba93a12b2b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:46.417000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cbc81ecb-1208-4e6b-b3dc-694fbc3749b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:46.481182 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1191/2395] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:04:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:51.334012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a49a6a-83dd-4dcb-b3f1-461e37ccb316 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:51.334860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a49a6a-83dd-4dcb-b3f1-461e37ccb316 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:51.335144 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a49a6a-83dd-4dcb-b3f1-461e37ccb316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:51.356393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-93a49a6a-83dd-4dcb-b3f1-461e37ccb316 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:51.358347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-93a49a6a-83dd-4dcb-b3f1-461e37ccb316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:51.367287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1205/2396] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:51.401516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc81ecb-1208-4e6b-b3dc-694fbc3749b8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:51.429540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc81ecb-1208-4e6b-b3dc-694fbc3749b8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:51.436148 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44b02-68ef-4337-a631-5a6345eadada service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:51.437105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44b02-68ef-4337-a631-5a6345eadada service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:51.438509 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44b02-68ef-4337-a631-5a6345eadada service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:51.439027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44b02-68ef-4337-a631-5a6345eadada service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:51.449808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44b02-68ef-4337-a631-5a6345eadada service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:51.452487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44b02-68ef-4337-a631-5a6345eadada service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:51.463971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1192/2397] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:04:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:04:52.251626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836306-ab6f-43b0-81ec-8db1b2db3ad6 None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:52.252026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836306-ab6f-43b0-81ec-8db1b2db3ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:52.252523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836306-ab6f-43b0-81ec-8db1b2db3ad6 None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:52.253940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1206/2398] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:04:52.263558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ad01-b85f-4fe3-ab6b-0d4c819f14d1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:52.264076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ad01-b85f-4fe3-ab6b-0d4c819f14d1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:52.264593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928ad01-b85f-4fe3-ab6b-0d4c819f14d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:52.380030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5928ad01-b85f-4fe3-ab6b-0d4c819f14d1 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:52.381488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5928ad01-b85f-4fe3-ab6b-0d4c819f14d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:52.543021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1193/2399] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:04:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:52.557499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836306-ab6f-43b0-81ec-8db1b2db3ad6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:52.561129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4e836306-ab6f-43b0-81ec-8db1b2db3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:52.589524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836306-ab6f-43b0-81ec-8db1b2db3ad6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:52.589524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244ccb-f2e8-41ec-914f-8a8a03ac34c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb36ac7a2e4643009bc1b0ca599203f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:52.589524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244ccb-f2e8-41ec-914f-8a8a03ac34c9 service glance] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:52.589524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244ccb-f2e8-41ec-914f-8a8a03ac34c9 service glance] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:52.590614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244ccb-f2e8-41ec-914f-8a8a03ac34c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:52.640699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25244ccb-f2e8-41ec-914f-8a8a03ac34c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:52.643528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25244ccb-f2e8-41ec-914f-8a8a03ac34c9 service glance] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:52.703627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1207/2400] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:53.030421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f228-9003-46e7-9d1c-fefba81303e7 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:53.031445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f228-9003-46e7-9d1c-fefba81303e7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:53.032211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f228-9003-46e7-9d1c-fefba81303e7 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:53.034572 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1194/2401] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:04:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:04:53.044431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7230a-70bb-4270-83ec-15e9a5340e22 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:53.045273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7230a-70bb-4270-83ec-15e9a5340e22 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:53.045273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7230a-70bb-4270-83ec-15e9a5340e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:53.071932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-ece7230a-70bb-4270-83ec-15e9a5340e22 None None] MFA Rules not processed for user `04a07eaeae594cc99cc07da7a4fc6b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:53.076694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ece7230a-70bb-4270-83ec-15e9a5340e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:53.208965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1208/2402] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:04:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:53.223508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27f228-9003-46e7-9d1c-fefba81303e7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:53.225644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3d27f228-9003-46e7-9d1c-fefba81303e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:53.251325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27f228-9003-46e7-9d1c-fefba81303e7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:53.256359 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc8342-efda-4827-9497-ea891959e90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:53.257767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc8342-efda-4827-9497-ea891959e90b service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:53.259300 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc8342-efda-4827-9497-ea891959e90b service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:53.259583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc8342-efda-4827-9497-ea891959e90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:53.270650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc8342-efda-4827-9497-ea891959e90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:53.272269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc8342-efda-4827-9497-ea891959e90b service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:53.288961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1195/2403] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:04:53.457268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26da5-c37d-4c49-b5c0-f465090a1a1a None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:53.457623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26da5-c37d-4c49-b5c0-f465090a1a1a None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:53.457917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26da5-c37d-4c49-b5c0-f465090a1a1a None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:53.459687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1209/2404] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:04:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:04:53.476988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecbee9-8c95-4a2f-aeb5-f40ec2113c79 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:53.477641 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecbee9-8c95-4a2f-aeb5-f40ec2113c79 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:53.478184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecbee9-8c95-4a2f-aeb5-f40ec2113c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:53.518946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-32ecbee9-8c95-4a2f-aeb5-f40ec2113c79 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:04:53.520616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-32ecbee9-8c95-4a2f-aeb5-f40ec2113c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:04:53.538273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1196/2405] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:04:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:04:53.555485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d26da5-c37d-4c49-b5c0-f465090a1a1a None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:04:53.577494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d26da5-c37d-4c49-b5c0-f465090a1a1a None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:04:53.583713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4240f-4f26-4bac-b6cf-a22c38584b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:04:53.584949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4240f-4f26-4bac-b6cf-a22c38584b07 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:04:53.585447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4240f-4f26-4bac-b6cf-a22c38584b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:04:53.586224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4240f-4f26-4bac-b6cf-a22c38584b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:04:53.631938 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4240f-4f26-4bac-b6cf-a22c38584b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:04:53.634047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4240f-4f26-4bac-b6cf-a22c38584b07 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:04:53.663415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1210/2406] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:04:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:03.502365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=86 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:03.652806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=41 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:04.929523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd3db-ff7c-436f-a3e6-b92a6e394b59 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:04.930217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd3db-ff7c-436f-a3e6-b92a6e394b59 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:04.930327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cd3db-ff7c-436f-a3e6-b92a6e394b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:04.951109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-636cd3db-ff7c-436f-a3e6-b92a6e394b59 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:04.952320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-636cd3db-ff7c-436f-a3e6-b92a6e394b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:04.960297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1197/2407] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:05:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:04.979606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4240f-4f26-4bac-b6cf-a22c38584b07 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:04.992076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4240f-4f26-4bac-b6cf-a22c38584b07 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:04.997257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfce70-ba2e-4089-a202-a92147ba002b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:04.997901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfce70-ba2e-4089-a202-a92147ba002b service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:04.998256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfce70-ba2e-4089-a202-a92147ba002b service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:04.998540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfce70-ba2e-4089-a202-a92147ba002b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:05.007921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfce70-ba2e-4089-a202-a92147ba002b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:05.009503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfce70-ba2e-4089-a202-a92147ba002b service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:05.018028 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1211/2408] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:05:14.945512 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:15.014597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:17.651372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ec6c-2c50-4661-a27f-6be4208503bb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:17.652429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ec6c-2c50-4661-a27f-6be4208503bb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:17.652909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7ec6c-2c50-4661-a27f-6be4208503bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:17.682883 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e6d7ec6c-2c50-4661-a27f-6be4208503bb None None] MFA Rules not processed for user `c5c6763ac1ea47da89d3bb29d630b48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:17.684189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e6d7ec6c-2c50-4661-a27f-6be4208503bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:17.748500 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1198/2409] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:05:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:26.356211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347df3fa-c500-407e-ba25-d23a0b6d5d5c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:26.356686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347df3fa-c500-407e-ba25-d23a0b6d5d5c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:26.356782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347df3fa-c500-407e-ba25-d23a0b6d5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:26.374688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-347df3fa-c500-407e-ba25-d23a0b6d5d5c None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:05:26.375932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-347df3fa-c500-407e-ba25-d23a0b6d5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:26.383396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1212/2410] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 22 09:05:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:05:26.395961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ec6c-2c50-4661-a27f-6be4208503bb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:26.409247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7ec6c-2c50-4661-a27f-6be4208503bb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:26.415428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a71cf-4c6c-40c1-bd90-4e87d6482044 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:26.416075 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a71cf-4c6c-40c1-bd90-4e87d6482044 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:26.416420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a71cf-4c6c-40c1-bd90-4e87d6482044 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:26.416637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a71cf-4c6c-40c1-bd90-4e87d6482044 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:26.425851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a71cf-4c6c-40c1-bd90-4e87d6482044 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:26.427490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a71cf-4c6c-40c1-bd90-4e87d6482044 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:26.436113 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1199/2411] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:05:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:05:31.078502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347df3fa-c500-407e-ba25-d23a0b6d5d5c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:31.088318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347df3fa-c500-407e-ba25-d23a0b6d5d5c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:31.091948 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e2bc-e3ac-48d5-855b-8920b5733536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:31.092561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e2bc-e3ac-48d5-855b-8920b5733536 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:31.092837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e2bc-e3ac-48d5-855b-8920b5733536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:31.093109 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0e2bc-e3ac-48d5-855b-8920b5733536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:31.103173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0e2bc-e3ac-48d5-855b-8920b5733536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:31.104946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0e2bc-e3ac-48d5-855b-8920b5733536 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:31.115404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1213/2412] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:36.283947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a71cf-4c6c-40c1-bd90-4e87d6482044 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:36.293524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a71cf-4c6c-40c1-bd90-4e87d6482044 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:36.297526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:36.298164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:36.298451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:36.298738 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:36.300554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:36.314324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:36.315754 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:36.327339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1200/2413] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:37.153783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e2bc-e3ac-48d5-855b-8920b5733536 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:05:37.165479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0e2bc-e3ac-48d5-855b-8920b5733536 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:05:37.170365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:05:37.171278 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:05:37.171788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:05:37.172320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:05:37.174586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:05:37.198949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:05:37.200756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:05:37.217907 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1214/2414] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:05:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:05:46.322378 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=37 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:05:47.211953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=15 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:02.694119 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:02.695725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:02.710089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ece52-9415-4cfa-bb19-78851b76ad73 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:02.715694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:02.716334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:02.716614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:02.716890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:02.718850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:02.729772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:02.731301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:02.741158 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1201/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:05.434535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:05.435985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:05.520187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494733cc-1a27-48a4-bb88-3bdf8aec7a0f service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:05.524047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a9f51-ea34-4a57-9091-276dc66b9526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:05.524695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9f51-ea34-4a57-9091-276dc66b9526 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:05.524997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9f51-ea34-4a57-9091-276dc66b9526 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:05.525267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9f51-ea34-4a57-9091-276dc66b9526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:05.527113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b74a9f51-ea34-4a57-9091-276dc66b9526 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:05.539248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a9f51-ea34-4a57-9091-276dc66b9526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:05.540711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a9f51-ea34-4a57-9091-276dc66b9526 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:05.550263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1215/2416] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:08.509290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:08.519034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57df87f-5643-448f-8fd2-d347a92546ed service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:08.522630 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fc69b-0286-438b-9a57-d0aabbc06e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:08.523274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fc69b-0286-438b-9a57-d0aabbc06e10 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:08.523561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fc69b-0286-438b-9a57-d0aabbc06e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:08.523842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fc69b-0286-438b-9a57-d0aabbc06e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:08.525623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c68fc69b-0286-438b-9a57-d0aabbc06e10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:08.536873 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fc69b-0286-438b-9a57-d0aabbc06e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:08.538350 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fc69b-0286-438b-9a57-d0aabbc06e10 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:08.548023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1202/2417] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:14.242605 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748436d-012f-424f-b807-2319f7cb483b None None] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:14.243209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748436d-012f-424f-b807-2319f7cb483b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:14.243307 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748436d-012f-424f-b807-2319f7cb483b None None] PATH_INFO: `/` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:14.244652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1216/2418] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:06:14.255090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011bb2-cf1e-4369-8199-6e983e645e0c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:14.255090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011bb2-cf1e-4369-8199-6e983e645e0c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:14.255090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a011bb2-cf1e-4369-8199-6e983e645e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:14.275672 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2a011bb2-cf1e-4369-8199-6e983e645e0c None None] MFA Rules not processed for user `04a07eaeae594cc99cc07da7a4fc6b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:14.276918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2a011bb2-cf1e-4369-8199-6e983e645e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:14.283849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1203/2419] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:06:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:14.296186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748436d-012f-424f-b807-2319f7cb483b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:14.315513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748436d-012f-424f-b807-2319f7cb483b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:14.329023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621f21a-7629-4c57-85cc-dd4e20022391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:14.329023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f21a-7629-4c57-85cc-dd4e20022391 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:14.329023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f21a-7629-4c57-85cc-dd4e20022391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:14.329023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621f21a-7629-4c57-85cc-dd4e20022391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:14.333003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621f21a-7629-4c57-85cc-dd4e20022391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:14.334497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621f21a-7629-4c57-85cc-dd4e20022391 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:14.342603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1217/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:14.429719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387aae-ee94-4b07-8da9-39f06357e056 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:14.429928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387aae-ee94-4b07-8da9-39f06357e056 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:14.430313 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387aae-ee94-4b07-8da9-39f06357e056 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:14.431838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1204/2421] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:06:14.438455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44afae2-cd46-45c9-99a1-5db317798435 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:14.438750 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44afae2-cd46-45c9-99a1-5db317798435 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:14.439030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44afae2-cd46-45c9-99a1-5db317798435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:14.459671 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f44afae2-cd46-45c9-99a1-5db317798435 None None] MFA Rules not processed for user `4ade274e49f748ee8e3bec2a963cf1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:14.461925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f44afae2-cd46-45c9-99a1-5db317798435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:14.470388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1218/2422] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:06:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:14.481143 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387aae-ee94-4b07-8da9-39f06357e056 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:14.492095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387aae-ee94-4b07-8da9-39f06357e056 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:14.495683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03c650-9107-4895-a83f-e91fe7b79aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:14.496318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c650-9107-4895-a83f-e91fe7b79aac service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:14.496700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c650-9107-4895-a83f-e91fe7b79aac service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:14.496978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c650-9107-4895-a83f-e91fe7b79aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:14.509335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03c650-9107-4895-a83f-e91fe7b79aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:14.511209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03c650-9107-4895-a83f-e91fe7b79aac service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:14.524293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1205/2423] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:14.588735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44afae2-cd46-45c9-99a1-5db317798435 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:14.590144 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f44afae2-cd46-45c9-99a1-5db317798435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:14.660802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44afae2-cd46-45c9-99a1-5db317798435 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:14.666108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:14.666766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:14.667052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:14.667332 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:14.669159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:14.681809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:14.683416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:14.694468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1219/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:24.469157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03c650-9107-4895-a83f-e91fe7b79aac service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:24.485307 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03c650-9107-4895-a83f-e91fe7b79aac service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:24.512783 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66969460-0b20-4d7b-9856-5a13a4d1c984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:24.514681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66969460-0b20-4d7b-9856-5a13a4d1c984 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:24.514952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66969460-0b20-4d7b-9856-5a13a4d1c984 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:24.515310 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66969460-0b20-4d7b-9856-5a13a4d1c984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:24.521814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-66969460-0b20-4d7b-9856-5a13a4d1c984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:24.556825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66969460-0b20-4d7b-9856-5a13a4d1c984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:24.558857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66969460-0b20-4d7b-9856-5a13a4d1c984 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:24.597694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1206/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:24.691959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=76 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:28.168784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:28.170471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:28.188960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12962eae-c29b-444d-9553-61123ba11640 service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:28.196145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:28.197322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:28.197848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:28.198171 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:28.200246 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:28.214796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:28.216376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:28.228149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1220/2426] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:30.718553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24518cc4-5f0c-47cc-be50-f2a64a5918d8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:30.719042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24518cc4-5f0c-47cc-be50-f2a64a5918d8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:30.719134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24518cc4-5f0c-47cc-be50-f2a64a5918d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:30.725766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=28 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:30.738075 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-24518cc4-5f0c-47cc-be50-f2a64a5918d8 None None] MFA Rules not processed for user `dd07859f7aba4b908b2779af70a5f5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:30.739329 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-24518cc4-5f0c-47cc-be50-f2a64a5918d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:30.800849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1207/2427] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:31.124111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:31.134608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8358d3-99f1-47c5-8af8-a95ad47d29c4 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:31.138541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:31.140454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:31.140454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:31.140454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:31.142799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:31.154229 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:31.155785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:31.165772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1221/2428] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:31.253115 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58cc3f-6114-45e4-bf3e-b3b7c3c1607a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:31.253485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58cc3f-6114-45e4-bf3e-b3b7c3c1607a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:31.253799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58cc3f-6114-45e4-bf3e-b3b7c3c1607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:31.273843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8d58cc3f-6114-45e4-bf3e-b3b7c3c1607a None None] MFA Rules not processed for user `cf981e5982644d708ddaba93a12b2b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:31.275449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8d58cc3f-6114-45e4-bf3e-b3b7c3c1607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:31.282671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1208/2429] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:31.928000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:31.936814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd0def-44df-401a-83fa-81e93e5e2a2d service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:31.941740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:31.945768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:31.945768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:31.945768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:31.945768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:31.955718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:31.957359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:31.966077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1222/2430] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:41.268703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=27 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:41.770299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58cc3f-6114-45e4-bf3e-b3b7c3c1607a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:41.780200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58cc3f-6114-45e4-bf3e-b3b7c3c1607a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:41.784114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:41.784760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:41.785066 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:41.785448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:41.787333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:41.852030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:41.853457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:41.864007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1209/2431] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:41.962226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=18 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:45.754385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:45.755857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:45.771442 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dc540-c17d-44ad-8dd2-0ebb0bfd7aba service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:45.776629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:45.777281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:45.777568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:45.777855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:45.779700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:45.794019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:45.795714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:45.806489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1223/2432] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:45.883248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:45.884677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:45.899492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4131572-fbd0-43f7-808f-0200d320d630 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:45.904278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:45.905153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:45.905536 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:45.905897 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] PATH_INFO: `/v3/users/c5c6763ac1ea47da89d3bb29d630b48c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:45.907172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c6763ac1ea47da89d3bb29d630b48c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:45.909072 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:46.052784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c6763ac1ea47da89d3bb29d630b48c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.053430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c6763ac1ea47da89d3bb29d630b48c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.060399 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c6763ac1ea47da89d3bb29d630b48c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.060988 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c6763ac1ea47da89d3bb29d630b48c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.119376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-fc22c48c-275e-4173-ba04-8e1af6e06c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c6763ac1ea47da89d3bb29d630b48c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.138871 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1210/2433] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:06:45 2022] DELETE /identity/v3/users/c5c6763ac1ea47da89d3bb29d630b48c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:46.562810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:46.574034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c31e7-df4b-4b02-a4fe-2e3ffca2093e service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:46.660771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:46.661695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:46.661976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:46.662276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] PATH_INFO: `/v3/projects/d20fd7bac1c94a908fd293fa82c534dc` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:46.663550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d20fd7bac1c94a908fd293fa82c534dc)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:46.665428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:46.773937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd20fd7bac1c94a908fd293fa82c534dc', 'request_id': 'req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.780186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd20fd7bac1c94a908fd293fa82c534dc', 'request_id': 'req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.786789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd20fd7bac1c94a908fd293fa82c534dc', 'request_id': 'req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.873451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] The token cache is being invalidate because project d20fd7bac1c94a908fd293fa82c534dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:06:46.873812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.874408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-34f52dc7-9051-4bd6-a37b-00fe2d28aa8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:46.876330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1224/2434] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:06:46 2022] DELETE /identity/v3/projects/d20fd7bac1c94a908fd293fa82c534dc => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:46.880954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c924-0f42-4ded-9261-e8db41de6f72 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:46.881246 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c924-0f42-4ded-9261-e8db41de6f72 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:46.881526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c924-0f42-4ded-9261-e8db41de6f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:46.903010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e4f8c924-0f42-4ded-9261-e8db41de6f72 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:46.904274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e4f8c924-0f42-4ded-9261-e8db41de6f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:46.964095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1211/2435] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:46.972386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e800-db7e-4274-880d-e17746a1c39f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:46.972676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e800-db7e-4274-880d-e17746a1c39f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:46.972951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e800-db7e-4274-880d-e17746a1c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:46.992005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e254e800-db7e-4274-880d-e17746a1c39f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:46.993153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e254e800-db7e-4274-880d-e17746a1c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:47.001293 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1225/2436] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:06:47.005559 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c924-0f42-4ded-9261-e8db41de6f72 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:47.015624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c924-0f42-4ded-9261-e8db41de6f72 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:47.021164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:47.021820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.022144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.022430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.023161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:06:47.023476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:47.025072 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:47.026600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:47.038250 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1212/2437] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:06:47.042545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e800-db7e-4274-880d-e17746a1c39f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:47.052376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e800-db7e-4274-880d-e17746a1c39f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:47.057077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5159-1f61-4bf4-b0a9-481c196595f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:47.057724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5159-1f61-4bf4-b0a9-481c196595f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.058006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5159-1f61-4bf4-b0a9-481c196595f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.058375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f5159-1f61-4bf4-b0a9-481c196595f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.059071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5159-1f61-4bf4-b0a9-481c196595f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:47.061050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f5159-1f61-4bf4-b0a9-481c196595f5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:47.169852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1226/2438] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:06:47 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:06:47.174353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:47.184610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c46282-6b30-4442-9c62-2535d4ba34f9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:47.243723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c733-67c8-4dd8-a128-ffd4576bbe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:47.244399 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c733-67c8-4dd8-a128-ffd4576bbe2c admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.244685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c733-67c8-4dd8-a128-ffd4576bbe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.244963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832c733-67c8-4dd8-a128-ffd4576bbe2c admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.245651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832c733-67c8-4dd8-a128-ffd4576bbe2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:47.247595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832c733-67c8-4dd8-a128-ffd4576bbe2c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:47.360412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1213/2439] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:06:47 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:06:47.364618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5159-1f61-4bf4-b0a9-481c196595f5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:47.374891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f5159-1f61-4bf4-b0a9-481c196595f5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:47.379979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c1a-6ab4-4be6-a9c2-6e3de5f7eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:47.381136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c1a-6ab4-4be6-a9c2-6e3de5f7eb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.381556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c1a-6ab4-4be6-a9c2-6e3de5f7eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.381879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec232c1a-6ab4-4be6-a9c2-6e3de5f7eb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.382965 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec232c1a-6ab4-4be6-a9c2-6e3de5f7eb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:47.384507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec232c1a-6ab4-4be6-a9c2-6e3de5f7eb85 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:47.395932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1227/2440] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:06:47.405819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c733-67c8-4dd8-a128-ffd4576bbe2c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:47.416154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832c733-67c8-4dd8-a128-ffd4576bbe2c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:47.420899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87944255-0bbd-4147-8c75-5eb95a7a59e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:47.421594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944255-0bbd-4147-8c75-5eb95a7a59e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.421884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944255-0bbd-4147-8c75-5eb95a7a59e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.422217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944255-0bbd-4147-8c75-5eb95a7a59e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.423145 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87944255-0bbd-4147-8c75-5eb95a7a59e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:47.424797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87944255-0bbd-4147-8c75-5eb95a7a59e7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:47.434878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1214/2441] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:06:47.439732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c1a-6ab4-4be6-a9c2-6e3de5f7eb85 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:47.449855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec232c1a-6ab4-4be6-a9c2-6e3de5f7eb85 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:47.455261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e53b10-e779-4355-a3f1-d3d825239fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:47.456140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e53b10-e779-4355-a3f1-d3d825239fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.456421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e53b10-e779-4355-a3f1-d3d825239fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.456696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e53b10-e779-4355-a3f1-d3d825239fed admin admin] PATH_INFO: `/v3/projects/138b7fc1de6d4709aeef2ddd4cbc2e64/users/79ebb8d7d47a40b6bab0145ad09d5006/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.473255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e53b10-e779-4355-a3f1-d3d825239fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=138b7fc1de6d4709aeef2ddd4cbc2e64, user_id=79ebb8d7d47a40b6bab0145ad09d5006, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:47.475864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e53b10-e779-4355-a3f1-d3d825239fed admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:47.548784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1228/2442] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:06:47 2022] PUT /identity/v3/projects/138b7fc1de6d4709aeef2ddd4cbc2e64/users/79ebb8d7d47a40b6bab0145ad09d5006/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:47.558814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f3f8-1633-4636-b740-f4816dd324ed None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.559105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f3f8-1633-4636-b740-f4816dd324ed None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.559386 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f3f8-1633-4636-b740-f4816dd324ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.588239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7547f3f8-1633-4636-b740-f4816dd324ed None None] MFA Rules not processed for user `79ebb8d7d47a40b6bab0145ad09d5006`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:47.588750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7547f3f8-1633-4636-b740-f4816dd324ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:47.657815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1215/2443] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:47.662726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e53b10-e779-4355-a3f1-d3d825239fed admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:47.669415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:47.733052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e53b10-e779-4355-a3f1-d3d825239fed admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:47.739261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3481d7-0d8b-4100-8636-0f7233ac8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:47.741152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3481d7-0d8b-4100-8636-0f7233ac8994 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.741152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3481d7-0d8b-4100-8636-0f7233ac8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.741152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3481d7-0d8b-4100-8636-0f7233ac8994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.741448 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3481d7-0d8b-4100-8636-0f7233ac8994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:47.743587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3481d7-0d8b-4100-8636-0f7233ac8994 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:47.869600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1229/2444] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:06:47 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:06:47.874016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f3f8-1633-4636-b740-f4816dd324ed None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:47.886184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f3f8-1633-4636-b740-f4816dd324ed None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:47.946902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce60f-3616-4f36-97bf-044b83be0e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:47.948301 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce60f-3616-4f36-97bf-044b83be0e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:47.948600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce60f-3616-4f36-97bf-044b83be0e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:47.948877 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce60f-3616-4f36-97bf-044b83be0e9a admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:47.949580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce60f-3616-4f36-97bf-044b83be0e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:47.951558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce60f-3616-4f36-97bf-044b83be0e9a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:47.960847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:48.065519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1216/2445] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:06:47 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:06:48.067294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3481d7-0d8b-4100-8636-0f7233ac8994 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:48.077470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3481d7-0d8b-4100-8636-0f7233ac8994 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:48.082271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0c11b-6d23-42cd-9c47-0904186c60ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:48.082943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c11b-6d23-42cd-9c47-0904186c60ec admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:48.083223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c11b-6d23-42cd-9c47-0904186c60ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:48.083501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0c11b-6d23-42cd-9c47-0904186c60ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:48.084270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c11b-6d23-42cd-9c47-0904186c60ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:48.085842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0c11b-6d23-42cd-9c47-0904186c60ec admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:48.097592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1230/2446] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:06:48.107588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce60f-3616-4f36-97bf-044b83be0e9a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:48.118625 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce60f-3616-4f36-97bf-044b83be0e9a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:48.123234 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e94558-bc3d-4495-8ab1-203036dcc31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:48.124121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e94558-bc3d-4495-8ab1-203036dcc31c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:48.124406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e94558-bc3d-4495-8ab1-203036dcc31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:48.124687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e94558-bc3d-4495-8ab1-203036dcc31c admin admin] PATH_INFO: `/v3/projects/249bb9dcc0564b3991594f5dea678af6/users/a619ae762f1045188dc960fc70d7d504/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:48.141952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e94558-bc3d-4495-8ab1-203036dcc31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=249bb9dcc0564b3991594f5dea678af6, user_id=a619ae762f1045188dc960fc70d7d504, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:48.144669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e94558-bc3d-4495-8ab1-203036dcc31c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:48.262858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1217/2447] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:06:48 2022] PUT /identity/v3/projects/249bb9dcc0564b3991594f5dea678af6/users/a619ae762f1045188dc960fc70d7d504/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:48.266859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0c11b-6d23-42cd-9c47-0904186c60ec admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:48.276933 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0c11b-6d23-42cd-9c47-0904186c60ec admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:48.334575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afd7a-5bad-4150-8bdf-90df501289d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:48.335244 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afd7a-5bad-4150-8bdf-90df501289d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:48.335525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afd7a-5bad-4150-8bdf-90df501289d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:48.335798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afd7a-5bad-4150-8bdf-90df501289d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:48.336520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616afd7a-5bad-4150-8bdf-90df501289d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:48.338110 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616afd7a-5bad-4150-8bdf-90df501289d6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:48.348424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1231/2448] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:06:48.352649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e94558-bc3d-4495-8ab1-203036dcc31c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:48.363381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e94558-bc3d-4495-8ab1-203036dcc31c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:48.368175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:48.369060 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:48.369379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:48.369659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] PATH_INFO: `/v3/projects/249bb9dcc0564b3991594f5dea678af6/users/a619ae762f1045188dc960fc70d7d504/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:48.371731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249bb9dcc0564b3991594f5dea678af6, user_id=a619ae762f1045188dc960fc70d7d504, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:48.374526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:48.397296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1218/2449] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:06:48 2022] PUT /identity/v3/projects/249bb9dcc0564b3991594f5dea678af6/users/a619ae762f1045188dc960fc70d7d504/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:48.402289 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f3db0-3db0-498b-809a-dcee9b19713c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:48.402601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f3db0-3db0-498b-809a-dcee9b19713c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:48.402936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f3db0-3db0-498b-809a-dcee9b19713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:48.431413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b48f3db0-3db0-498b-809a-dcee9b19713c None None] MFA Rules not processed for user `a619ae762f1045188dc960fc70d7d504`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:48.432638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b48f3db0-3db0-498b-809a-dcee9b19713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:48.508900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:48.513039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1232/2450] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:48.524110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:48.526218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:48.607351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38a2c3-172d-4c8f-8be4-c49528d3bfe6 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:48.612324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3a6d-4d58-4cfe-a48e-fb04b4f5f2fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:48.613370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3a6d-4d58-4cfe-a48e-fb04b4f5f2fa service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:48.614252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3a6d-4d58-4cfe-a48e-fb04b4f5f2fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:48.614252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef3a6d-4d58-4cfe-a48e-fb04b4f5f2fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:48.626319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef3a6d-4d58-4cfe-a48e-fb04b4f5f2fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:48.627383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef3a6d-4d58-4cfe-a48e-fb04b4f5f2fa service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:48.637439 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1219/2451] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:50.290859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f3db0-3db0-498b-809a-dcee9b19713c None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:50.293489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b48f3db0-3db0-498b-809a-dcee9b19713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:50.388985 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f3db0-3db0-498b-809a-dcee9b19713c None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:50.394832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94f82d-3609-4613-91e0-935ea0671239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:50.395673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f82d-3609-4613-91e0-935ea0671239 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:50.395962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f82d-3609-4613-91e0-935ea0671239 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:50.396240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94f82d-3609-4613-91e0-935ea0671239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:50.398121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cb94f82d-3609-4613-91e0-935ea0671239 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:50.411956 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94f82d-3609-4613-91e0-935ea0671239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:50.413546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94f82d-3609-4613-91e0-935ea0671239 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:50.427453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1233/2452] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:51.618344 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3a6d-4d58-4cfe-a48e-fb04b4f5f2fa service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:51.681140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef3a6d-4d58-4cfe-a48e-fb04b4f5f2fa service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:51.685703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:51.686618 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:51.686907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:51.687185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] PATH_INFO: `/v3/users/79ebb8d7d47a40b6bab0145ad09d5006` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:51.689062 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ebb8d7d47a40b6bab0145ad09d5006)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:51.691102 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:51.862802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ebb8d7d47a40b6bab0145ad09d5006'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:51.863469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ebb8d7d47a40b6bab0145ad09d5006'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:51.870474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ebb8d7d47a40b6bab0145ad09d5006'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:51.871107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ebb8d7d47a40b6bab0145ad09d5006'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:51.873827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:51.985428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ebb8d7d47a40b6bab0145ad09d5006'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:52.003976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1220/2453] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:06:51 2022] DELETE /identity/v3/users/79ebb8d7d47a40b6bab0145ad09d5006 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:52.008662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5402d5d-ce3b-419c-b936-da7419133d92 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:52.009144 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5402d5d-ce3b-419c-b936-da7419133d92 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:52.009242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5402d5d-ce3b-419c-b936-da7419133d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:52.026785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-d5402d5d-ce3b-419c-b936-da7419133d92 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:52.028663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d5402d5d-ce3b-419c-b936-da7419133d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:52.087465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1234/2454] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:52.098389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:52.099804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:52.157849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c64d36-4465-4acf-8f89-4efce726dcc7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:52.162334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571dc7d-a80e-4d44-be08-67ce833095df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:52.162983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571dc7d-a80e-4d44-be08-67ce833095df service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:52.163263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571dc7d-a80e-4d44-be08-67ce833095df service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:52.163564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571dc7d-a80e-4d44-be08-67ce833095df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:52.172921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571dc7d-a80e-4d44-be08-67ce833095df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:52.174561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571dc7d-a80e-4d44-be08-67ce833095df service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:52.184280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1221/2455] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:52.615628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5402d5d-ce3b-419c-b936-da7419133d92 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:52.617014 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d5402d5d-ce3b-419c-b936-da7419133d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:52.632373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5402d5d-ce3b-419c-b936-da7419133d92 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:52.638928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:52.640189 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:52.640509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:52.641470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] PATH_INFO: `/v3/projects/138b7fc1de6d4709aeef2ddd4cbc2e64` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:52.642768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138b7fc1de6d4709aeef2ddd4cbc2e64)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:52.644662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:52.769642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138b7fc1de6d4709aeef2ddd4cbc2e64', 'request_id': 'req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:52.777196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138b7fc1de6d4709aeef2ddd4cbc2e64', 'request_id': 'req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:52.784151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138b7fc1de6d4709aeef2ddd4cbc2e64', 'request_id': 'req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:52.888376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] The token cache is being invalidate because project 138b7fc1de6d4709aeef2ddd4cbc2e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:06:52.888698 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:52.889335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:52.891091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1235/2456] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:06:52 2022] DELETE /identity/v3/projects/138b7fc1de6d4709aeef2ddd4cbc2e64 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:52.895077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571dc7d-a80e-4d44-be08-67ce833095df service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:52.905548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571dc7d-a80e-4d44-be08-67ce833095df service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:52.963720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:52.964596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:52.964880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:52.965154 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] PATH_INFO: `/v3/users/a619ae762f1045188dc960fc70d7d504` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:52.966381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a619ae762f1045188dc960fc70d7d504)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:52.968295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:53.174339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a619ae762f1045188dc960fc70d7d504'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.174880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a619ae762f1045188dc960fc70d7d504'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.182114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a619ae762f1045188dc960fc70d7d504'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.182768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a619ae762f1045188dc960fc70d7d504'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.270426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b3312898-65d1-419d-b873-47fd9ee9837f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a619ae762f1045188dc960fc70d7d504'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.284430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:53.289729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1222/2457] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:06:52 2022] DELETE /identity/v3/users/a619ae762f1045188dc960fc70d7d504 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:53.732455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:53.734857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:53.748826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be51ea-a9e3-470e-8437-5bd8a0ffd064 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:53.755024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:53.809916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:53.810801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:53.811078 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:53.811348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] PATH_INFO: `/v3/projects/249bb9dcc0564b3991594f5dea678af6` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:53.813410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=249bb9dcc0564b3991594f5dea678af6)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:53.815387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:53.915056 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249bb9dcc0564b3991594f5dea678af6', 'request_id': 'req-f395dc13-a0f4-4bb4-907e-1327c397d2ca'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.921351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249bb9dcc0564b3991594f5dea678af6', 'request_id': 'req-f395dc13-a0f4-4bb4-907e-1327c397d2ca'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.927394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249bb9dcc0564b3991594f5dea678af6', 'request_id': 'req-f395dc13-a0f4-4bb4-907e-1327c397d2ca'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.987480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] The token cache is being invalidate because project 249bb9dcc0564b3991594f5dea678af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:06:53.996115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.996115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f395dc13-a0f4-4bb4-907e-1327c397d2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:06:53.996115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1236/2458] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:06:53 2022] DELETE /identity/v3/projects/249bb9dcc0564b3991594f5dea678af6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:53.996376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd23a22-72ae-43ae-9d37-207e58306c06 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:53.996376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd23a22-72ae-43ae-9d37-207e58306c06 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:53.996376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd23a22-72ae-43ae-9d37-207e58306c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.014964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bfd23a22-72ae-43ae-9d37-207e58306c06 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:54.016203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bfd23a22-72ae-43ae-9d37-207e58306c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:54.075208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1223/2459] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:54.083038 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89494-e1cf-45f2-a88b-68ebb594c2e4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.083327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89494-e1cf-45f2-a88b-68ebb594c2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.083607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d89494-e1cf-45f2-a88b-68ebb594c2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.103423 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a3d89494-e1cf-45f2-a88b-68ebb594c2e4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:54.104908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a3d89494-e1cf-45f2-a88b-68ebb594c2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:54.113895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1237/2460] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:54.117999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd23a22-72ae-43ae-9d37-207e58306c06 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:54.127937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd23a22-72ae-43ae-9d37-207e58306c06 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:54.132537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:54.133178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.133465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.133739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.134497 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:06:54.134801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:54.136370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:54.147673 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1224/2461] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:06:54.151906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d89494-e1cf-45f2-a88b-68ebb594c2e4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:54.161804 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d89494-e1cf-45f2-a88b-68ebb594c2e4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:54.166492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745e75c-696e-4aff-98a8-14ba647b255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:54.167130 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e75c-696e-4aff-98a8-14ba647b255a admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.167410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e75c-696e-4aff-98a8-14ba647b255a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.167685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e75c-696e-4aff-98a8-14ba647b255a admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.168379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745e75c-696e-4aff-98a8-14ba647b255a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:54.170271 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745e75c-696e-4aff-98a8-14ba647b255a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:54.254914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1238/2462] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:06:54 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:06:54.258984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:54.269397 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef245c-b2b0-42e8-aab4-584c7a4c35ca admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:54.327152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952bac0-944a-4ec1-8032-9265d83acc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:54.327821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952bac0-944a-4ec1-8032-9265d83acc2f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.328589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952bac0-944a-4ec1-8032-9265d83acc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.328868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952bac0-944a-4ec1-8032-9265d83acc2f admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.329670 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952bac0-944a-4ec1-8032-9265d83acc2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:54.331605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952bac0-944a-4ec1-8032-9265d83acc2f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:54.416275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1225/2463] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:06:54 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:06:54.420687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745e75c-696e-4aff-98a8-14ba647b255a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:54.431299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745e75c-696e-4aff-98a8-14ba647b255a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:54.436011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a499c-2bc1-42a9-a39a-980a8d8070e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:54.436683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a499c-2bc1-42a9-a39a-980a8d8070e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.436963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a499c-2bc1-42a9-a39a-980a8d8070e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.437279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a499c-2bc1-42a9-a39a-980a8d8070e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.438198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a499c-2bc1-42a9-a39a-980a8d8070e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:54.442518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a499c-2bc1-42a9-a39a-980a8d8070e6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:54.450175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1239/2464] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:06:54.456563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952bac0-944a-4ec1-8032-9265d83acc2f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:54.466756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952bac0-944a-4ec1-8032-9265d83acc2f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:54.472448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d11f3-b425-4ed7-99bb-e3a589ccddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:54.473140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d11f3-b425-4ed7-99bb-e3a589ccddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.473428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d11f3-b425-4ed7-99bb-e3a589ccddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.473711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d11f3-b425-4ed7-99bb-e3a589ccddb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.474479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d11f3-b425-4ed7-99bb-e3a589ccddb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:54.476073 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d11f3-b425-4ed7-99bb-e3a589ccddb2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:54.486556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1226/2465] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:06:54.490726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a499c-2bc1-42a9-a39a-980a8d8070e6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:54.500854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a499c-2bc1-42a9-a39a-980a8d8070e6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:54.505556 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:54.506437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.506727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.507004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] PATH_INFO: `/v3/projects/a761aaa222394f048d7c137a1bbd2775/users/267c35b6d539433f8d5cbcf5faeaf9da/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.522496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a761aaa222394f048d7c137a1bbd2775, user_id=267c35b6d539433f8d5cbcf5faeaf9da, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:54.525127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:54.600105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1240/2466] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:06:54 2022] PUT /identity/v3/projects/a761aaa222394f048d7c137a1bbd2775/users/267c35b6d539433f8d5cbcf5faeaf9da/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:54.605620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41d911-c366-42c9-bcaa-f0007d9b7220 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.605918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41d911-c366-42c9-bcaa-f0007d9b7220 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.606228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41d911-c366-42c9-bcaa-f0007d9b7220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.624744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1f41d911-c366-42c9-bcaa-f0007d9b7220 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:54.626108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1f41d911-c366-42c9-bcaa-f0007d9b7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:54.684037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1227/2467] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:54.693511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:54.695259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:54.735941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:54.754678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bc02d-eb23-4a16-bf4a-ecf553e230c3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:54.758963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895756e0-7ebe-49a0-99dc-b036209a76f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:54.759554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895756e0-7ebe-49a0-99dc-b036209a76f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:54.759831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895756e0-7ebe-49a0-99dc-b036209a76f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:54.760108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895756e0-7ebe-49a0-99dc-b036209a76f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:54.770661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895756e0-7ebe-49a0-99dc-b036209a76f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:54.772077 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895756e0-7ebe-49a0-99dc-b036209a76f2 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:54.781672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1241/2468] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:06:56.283800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a726f8-e8e3-4116-b95e-ef7c46f001b5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:56.284330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a726f8-e8e3-4116-b95e-ef7c46f001b5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:56.284426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a726f8-e8e3-4116-b95e-ef7c46f001b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:56.291186 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:56.311842 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f1a726f8-e8e3-4116-b95e-ef7c46f001b5 None None] MFA Rules not processed for user `267c35b6d539433f8d5cbcf5faeaf9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:56.313321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f1a726f8-e8e3-4116-b95e-ef7c46f001b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:56.378511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1228/2469] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:56.382930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895756e0-7ebe-49a0-99dc-b036209a76f2 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:56.393007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895756e0-7ebe-49a0-99dc-b036209a76f2 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:56.397543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7dae1-e143-41cb-b075-468c631bc769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:56.398225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7dae1-e143-41cb-b075-468c631bc769 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:56.398507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7dae1-e143-41cb-b075-468c631bc769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:56.398780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7dae1-e143-41cb-b075-468c631bc769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:56.399456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7dae1-e143-41cb-b075-468c631bc769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:56.401313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7dae1-e143-41cb-b075-468c631bc769 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:56.479848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1242/2470] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:06:56 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:06:56.483932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a726f8-e8e3-4116-b95e-ef7c46f001b5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:56.495628 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a726f8-e8e3-4116-b95e-ef7c46f001b5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:56.555577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c2c2-fc55-40d9-a1b5-282217a0c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:56.556707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c2c2-fc55-40d9-a1b5-282217a0c112 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:56.556707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c2c2-fc55-40d9-a1b5-282217a0c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:56.556884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c2c2-fc55-40d9-a1b5-282217a0c112 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:56.557453 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c2c2-fc55-40d9-a1b5-282217a0c112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:56.559384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c2c2-fc55-40d9-a1b5-282217a0c112 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:56.673925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1229/2471] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:06:56 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:06:56.677908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7dae1-e143-41cb-b075-468c631bc769 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:56.689192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7dae1-e143-41cb-b075-468c631bc769 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:56.694030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9936f-32ae-4bfb-bd8f-6acc4db32b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:56.694799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9936f-32ae-4bfb-bd8f-6acc4db32b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:56.695088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9936f-32ae-4bfb-bd8f-6acc4db32b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:56.695365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9936f-32ae-4bfb-bd8f-6acc4db32b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:56.696092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9936f-32ae-4bfb-bd8f-6acc4db32b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:56.697669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9936f-32ae-4bfb-bd8f-6acc4db32b66 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:56.709185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1243/2472] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:06:56.713438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c2c2-fc55-40d9-a1b5-282217a0c112 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:56.724699 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c2c2-fc55-40d9-a1b5-282217a0c112 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:56.729616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a14e02-275b-46c0-8b5f-57afb0c2323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:56.730607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14e02-275b-46c0-8b5f-57afb0c2323b admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:56.730830 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14e02-275b-46c0-8b5f-57afb0c2323b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:56.731111 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a14e02-275b-46c0-8b5f-57afb0c2323b admin admin] PATH_INFO: `/v3/projects/767f746560114b59a377f32b5c07991e/users/f84a62cf592d44189eada9f5be2b31e2/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:56.745985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a14e02-275b-46c0-8b5f-57afb0c2323b admin admin] RBAC: Authorizing `identity:create_grant(project_id=767f746560114b59a377f32b5c07991e, user_id=f84a62cf592d44189eada9f5be2b31e2, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:56.748703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a14e02-275b-46c0-8b5f-57afb0c2323b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:56.828726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1230/2473] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:06:56 2022] PUT /identity/v3/projects/767f746560114b59a377f32b5c07991e/users/f84a62cf592d44189eada9f5be2b31e2/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:56.832916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9936f-32ae-4bfb-bd8f-6acc4db32b66 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:56.843143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9936f-32ae-4bfb-bd8f-6acc4db32b66 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:56.900522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd600c2-5c55-4e64-9d14-da99902b0b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:56.901191 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd600c2-5c55-4e64-9d14-da99902b0b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:56.901479 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd600c2-5c55-4e64-9d14-da99902b0b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:56.901764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd600c2-5c55-4e64-9d14-da99902b0b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:56.902515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd600c2-5c55-4e64-9d14-da99902b0b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:56.904094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd600c2-5c55-4e64-9d14-da99902b0b90 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:56.914764 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1244/2474] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:06:56.919097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a14e02-275b-46c0-8b5f-57afb0c2323b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:56.929190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a14e02-275b-46c0-8b5f-57afb0c2323b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:56.933661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:56.934562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:56.934847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:56.935140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] PATH_INFO: `/v3/projects/767f746560114b59a377f32b5c07991e/users/f84a62cf592d44189eada9f5be2b31e2/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:56.937096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767f746560114b59a377f32b5c07991e, user_id=f84a62cf592d44189eada9f5be2b31e2, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:56.939875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:56.949925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1231/2475] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:06:56 2022] PUT /identity/v3/projects/767f746560114b59a377f32b5c07991e/users/f84a62cf592d44189eada9f5be2b31e2/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:06:58.189791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95536f0a-d5b4-4abf-915a-0c28f8b0c5e6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:58.190341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95536f0a-d5b4-4abf-915a-0c28f8b0c5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:58.190471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95536f0a-d5b4-4abf-915a-0c28f8b0c5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:58.219530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-95536f0a-d5b4-4abf-915a-0c28f8b0c5e6 None None] MFA Rules not processed for user `f84a62cf592d44189eada9f5be2b31e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:06:58.221389 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-95536f0a-d5b4-4abf-915a-0c28f8b0c5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:58.292513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1245/2476] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:06:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:06:58.303906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:06:58.305648 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:06:58.359281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:06:58.364640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f90a-37c7-4eee-8a0e-dd3309ce63f3 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:06:58.368197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2c73-9d49-43b8-9301-e12d8517db76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:06:58.368836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2c73-9d49-43b8-9301-e12d8517db76 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:06:58.370573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2c73-9d49-43b8-9301-e12d8517db76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:06:58.370573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2c73-9d49-43b8-9301-e12d8517db76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:06:58.426029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c2c73-9d49-43b8-9301-e12d8517db76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:06:58.427596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c2c73-9d49-43b8-9301-e12d8517db76 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:06:58.437998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1232/2477] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:06:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:00.166453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95536f0a-d5b4-4abf-915a-0c28f8b0c5e6 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:00.167857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-95536f0a-d5b4-4abf-915a-0c28f8b0c5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:00.180845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95536f0a-d5b4-4abf-915a-0c28f8b0c5e6 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:00.186260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8200bae-8ada-43ea-84cc-a6b8b2edf8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:00.186260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200bae-8ada-43ea-84cc-a6b8b2edf8cc service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:00.186260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200bae-8ada-43ea-84cc-a6b8b2edf8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:00.186260 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8200bae-8ada-43ea-84cc-a6b8b2edf8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:00.195069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200bae-8ada-43ea-84cc-a6b8b2edf8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:00.196495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8200bae-8ada-43ea-84cc-a6b8b2edf8cc service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:00.206317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1246/2478] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:08.434624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=27 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:10.201987 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:15.600620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc296-7d1d-4ff3-96ca-050c675729a4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:15.601461 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc296-7d1d-4ff3-96ca-050c675729a4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:15.601642 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fc296-7d1d-4ff3-96ca-050c675729a4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:15.603314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1233/2479] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 22 09:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:07:15.614009 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2244f-89ce-44d5-9630-1cd90dd0e97c None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:15.617284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2244f-89ce-44d5-9630-1cd90dd0e97c None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:15.617284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2244f-89ce-44d5-9630-1cd90dd0e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:15.653871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3dd2244f-89ce-44d5-9630-1cd90dd0e97c None None] MFA Rules not processed for user `0883944ff2a24f4fa51a7c06c3040f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:15.655005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3dd2244f-89ce-44d5-9630-1cd90dd0e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:15.718977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1247/2480] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 22 09:07:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:15.731471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fc296-7d1d-4ff3-96ca-050c675729a4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:15.733267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-657fc296-7d1d-4ff3-96ca-050c675729a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:15.751495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fc296-7d1d-4ff3-96ca-050c675729a4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:15.760617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:15.760617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:15.760617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:15.760617 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:15.769772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:15.771522 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:15.782295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1234/2481] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:16.100337 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eafb4d-5ed1-424f-835c-b65d698a563d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:16.100637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eafb4d-5ed1-424f-835c-b65d698a563d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:16.100921 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eafb4d-5ed1-424f-835c-b65d698a563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:16.120670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-07eafb4d-5ed1-424f-835c-b65d698a563d None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:16.121298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-07eafb4d-5ed1-424f-835c-b65d698a563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:16.179165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1248/2482] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 22 09:07:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:16.314586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:16.316863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:16.392413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5618c-082a-4578-b0c1-9757a98b13fd service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:16.398614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d68b4-a568-4a48-927b-036c6e9763ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:16.399284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d68b4-a568-4a48-927b-036c6e9763ce service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:16.399571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d68b4-a568-4a48-927b-036c6e9763ce service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:16.399852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d68b4-a568-4a48-927b-036c6e9763ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:16.408841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d68b4-a568-4a48-927b-036c6e9763ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:16.411325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d68b4-a568-4a48-927b-036c6e9763ce service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:16.420490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1235/2483] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:07:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:16.724934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eafb4d-5ed1-424f-835c-b65d698a563d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:16.793294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eafb4d-5ed1-424f-835c-b65d698a563d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:16.797856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:16.798778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:16.799093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:16.799373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] PATH_INFO: `/v3/users/267c35b6d539433f8d5cbcf5faeaf9da` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:16.800972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267c35b6d539433f8d5cbcf5faeaf9da)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:16.802962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:16.980069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:16.993862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267c35b6d539433f8d5cbcf5faeaf9da'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:16.994547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267c35b6d539433f8d5cbcf5faeaf9da'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:16.995145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267c35b6d539433f8d5cbcf5faeaf9da'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.085411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267c35b6d539433f8d5cbcf5faeaf9da'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.099280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267c35b6d539433f8d5cbcf5faeaf9da'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.111980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1249/2484] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:16 2022] DELETE /identity/v3/users/267c35b6d539433f8d5cbcf5faeaf9da => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:17.352668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d68b4-a568-4a48-927b-036c6e9763ce service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:17.365038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d68b4-a568-4a48-927b-036c6e9763ce service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:17.428581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:17.429444 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:17.429727 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:17.430001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] PATH_INFO: `/v3/projects/a761aaa222394f048d7c137a1bbd2775` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:17.431218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a761aaa222394f048d7c137a1bbd2775)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:17.433146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:17.564506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a761aaa222394f048d7c137a1bbd2775', 'request_id': 'req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.571161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a761aaa222394f048d7c137a1bbd2775', 'request_id': 'req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.656267 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a761aaa222394f048d7c137a1bbd2775', 'request_id': 'req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.669032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] The token cache is being invalidate because project a761aaa222394f048d7c137a1bbd2775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:17.669317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.677028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.677028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1236/2485] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:17 2022] DELETE /identity/v3/projects/a761aaa222394f048d7c137a1bbd2775 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:17.677281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:17.678469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:17.691807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b61e4-570c-4c35-b3b1-0d294de951a8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:17.752013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:17.752899 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:17.753189 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:17.753464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] PATH_INFO: `/v3/users/f84a62cf592d44189eada9f5be2b31e2` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:17.754991 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f84a62cf592d44189eada9f5be2b31e2)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:17.756914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:17.947858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f84a62cf592d44189eada9f5be2b31e2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.948524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f84a62cf592d44189eada9f5be2b31e2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:17.949136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f84a62cf592d44189eada9f5be2b31e2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.015949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f84a62cf592d44189eada9f5be2b31e2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.029703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1e9f15ac-9822-43ff-a450-e44874646021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f84a62cf592d44189eada9f5be2b31e2'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.043553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1250/2486] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:17 2022] DELETE /identity/v3/users/f84a62cf592d44189eada9f5be2b31e2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:18.278293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:18.280713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.294857 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27de46-4b06-42f3-b93e-cd04d8cff4f8 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:18.299486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:18.367136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:18.367136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.367136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.367136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] PATH_INFO: `/v3/projects/767f746560114b59a377f32b5c07991e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.367896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767f746560114b59a377f32b5c07991e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:18.369459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:18.492189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767f746560114b59a377f32b5c07991e', 'request_id': 'req-6f5a2aeb-502b-4900-b0eb-3e787a540a81'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.500062 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767f746560114b59a377f32b5c07991e', 'request_id': 'req-6f5a2aeb-502b-4900-b0eb-3e787a540a81'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.608139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767f746560114b59a377f32b5c07991e', 'request_id': 'req-6f5a2aeb-502b-4900-b0eb-3e787a540a81'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.624191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] The token cache is being invalidate because project 767f746560114b59a377f32b5c07991e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:18.624548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.625146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6f5a2aeb-502b-4900-b0eb-3e787a540a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:18.626741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1237/2487] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:18 2022] DELETE /identity/v3/projects/767f746560114b59a377f32b5c07991e => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:18.632060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2952f73-ba84-4acf-8bf9-a38b3ff8f2ac None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.632349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2952f73-ba84-4acf-8bf9-a38b3ff8f2ac None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.632630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2952f73-ba84-4acf-8bf9-a38b3ff8f2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.651255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e2952f73-ba84-4acf-8bf9-a38b3ff8f2ac None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:18.653046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e2952f73-ba84-4acf-8bf9-a38b3ff8f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.676953 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:18.721205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1251/2488] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:18.730211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5d2c-683a-4b7d-91af-799735b9f93a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.730510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5d2c-683a-4b7d-91af-799735b9f93a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.730793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec5d2c-683a-4b7d-91af-799735b9f93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.749856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a8ec5d2c-683a-4b7d-91af-799735b9f93a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:18.751190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a8ec5d2c-683a-4b7d-91af-799735b9f93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:18.761960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1238/2489] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:18.764772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2952f73-ba84-4acf-8bf9-a38b3ff8f2ac None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:18.775569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2952f73-ba84-4acf-8bf9-a38b3ff8f2ac None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:18.780922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:18.781584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.781868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.782180 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.783034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:18.783341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:18.785568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:18.798549 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1252/2490] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:07:18.803352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec5d2c-683a-4b7d-91af-799735b9f93a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:18.812875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec5d2c-683a-4b7d-91af-799735b9f93a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:18.817837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f9d2-b103-4b4a-9c25-3eb4a92225b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:18.818594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f9d2-b103-4b4a-9c25-3eb4a92225b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:18.819748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f9d2-b103-4b4a-9c25-3eb4a92225b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:18.819748 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f9d2-b103-4b4a-9c25-3eb4a92225b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:18.823997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f9d2-b103-4b4a-9c25-3eb4a92225b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:18.823997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f9d2-b103-4b4a-9c25-3eb4a92225b0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:18.922706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1239/2491] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:18 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:18.927133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:18.939321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03563206-cbf5-45d6-926b-561183f84316 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.010351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e84302-69d0-4736-9e1e-c8a3e06f7083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.011039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84302-69d0-4736-9e1e-c8a3e06f7083 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.011486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84302-69d0-4736-9e1e-c8a3e06f7083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.011777 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e84302-69d0-4736-9e1e-c8a3e06f7083 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.012572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e84302-69d0-4736-9e1e-c8a3e06f7083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.014509 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e84302-69d0-4736-9e1e-c8a3e06f7083 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.114299 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1253/2492] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:18 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:07:19.115692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f9d2-b103-4b4a-9c25-3eb4a92225b0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:19.126195 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f9d2-b103-4b4a-9c25-3eb4a92225b0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.131810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa03979-04d6-4a7c-9bf2-205c52460406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.132481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03979-04d6-4a7c-9bf2-205c52460406 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.132770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03979-04d6-4a7c-9bf2-205c52460406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.133052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03979-04d6-4a7c-9bf2-205c52460406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.133793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa03979-04d6-4a7c-9bf2-205c52460406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.135432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa03979-04d6-4a7c-9bf2-205c52460406 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.147364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1240/2493] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:19.151596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e84302-69d0-4736-9e1e-c8a3e06f7083 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:19.163047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e84302-69d0-4736-9e1e-c8a3e06f7083 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.168165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b2902-ab4b-4efa-9198-7089a4554208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.168978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b2902-ab4b-4efa-9198-7089a4554208 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.169279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b2902-ab4b-4efa-9198-7089a4554208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.169562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b2902-ab4b-4efa-9198-7089a4554208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.170344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b2902-ab4b-4efa-9198-7089a4554208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.171943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b2902-ab4b-4efa-9198-7089a4554208 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.187644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1254/2494] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:19.188325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa03979-04d6-4a7c-9bf2-205c52460406 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:19.200139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa03979-04d6-4a7c-9bf2-205c52460406 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.204909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.205804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.206122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.206410 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] PATH_INFO: `/v3/projects/627e34f2daff4d678131767118d56533/users/a4858887c1534163b137df7473e3a025/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.225556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627e34f2daff4d678131767118d56533, user_id=a4858887c1534163b137df7473e3a025, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.228438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.325201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1241/2495] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:19 2022] PUT /identity/v3/projects/627e34f2daff4d678131767118d56533/users/a4858887c1534163b137df7473e3a025/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:19.328114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11cdf-d2c1-4f92-95d8-a0490b53cf7d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.328416 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11cdf-d2c1-4f92-95d8-a0490b53cf7d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.328733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11cdf-d2c1-4f92-95d8-a0490b53cf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.366964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-c2f11cdf-d2c1-4f92-95d8-a0490b53cf7d None None] MFA Rules not processed for user `a4858887c1534163b137df7473e3a025`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:19.368360 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c2f11cdf-d2c1-4f92-95d8-a0490b53cf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.442494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1255/2496] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:19.453667 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:19.455463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:19.491459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:19.512613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44b3b-9191-40d8-a470-f83f15b7c457 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:19.516323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267f980-6631-4675-8dfd-feed21285664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:19.520116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267f980-6631-4675-8dfd-feed21285664 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:19.520116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267f980-6631-4675-8dfd-feed21285664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:19.520116 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267f980-6631-4675-8dfd-feed21285664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:19.526919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267f980-6631-4675-8dfd-feed21285664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:19.528289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267f980-6631-4675-8dfd-feed21285664 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:19.537855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1242/2497] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:24.413929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11cdf-d2c1-4f92-95d8-a0490b53cf7d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:24.416488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c2f11cdf-d2c1-4f92-95d8-a0490b53cf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:24.444811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:24.483469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11cdf-d2c1-4f92-95d8-a0490b53cf7d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:24.488113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:24.490153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:24.490153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:24.490153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] PATH_INFO: `/v3/users/448ee30440fb46779216649dd6907331` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:24.491396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448ee30440fb46779216649dd6907331)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:24.493239 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:24.664670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448ee30440fb46779216649dd6907331'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.665398 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448ee30440fb46779216649dd6907331'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.666050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448ee30440fb46779216649dd6907331'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.730742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448ee30440fb46779216649dd6907331'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.745317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448ee30440fb46779216649dd6907331'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:24.759026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1256/2498] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:24 2022] DELETE /identity/v3/users/448ee30440fb46779216649dd6907331 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:25.030084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267f980-6631-4675-8dfd-feed21285664 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.041582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267f980-6631-4675-8dfd-feed21285664 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:25.103542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:25.104652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:25.104933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:25.105205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] PATH_INFO: `/v3/projects/85bf3e1b89094cafa7d469ed3f84eb36` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:25.106413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bf3e1b89094cafa7d469ed3f84eb36)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:25.108302 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:25.199937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bf3e1b89094cafa7d469ed3f84eb36', 'request_id': 'req-35a54a78-b4c3-4084-894d-fa39c586a2e4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.205579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bf3e1b89094cafa7d469ed3f84eb36', 'request_id': 'req-35a54a78-b4c3-4084-894d-fa39c586a2e4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.270006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bf3e1b89094cafa7d469ed3f84eb36', 'request_id': 'req-35a54a78-b4c3-4084-894d-fa39c586a2e4'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.282023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] The token cache is being invalidate because project 85bf3e1b89094cafa7d469ed3f84eb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:25.282283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.283023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.284659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1243/2499] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:25 2022] DELETE /identity/v3/projects/85bf3e1b89094cafa7d469ed3f84eb36 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:25.289268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.290693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:25.304163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaa1e0-fb6c-43a5-aba2-fd84f0b28489 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:25.360066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:25.360930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:25.361211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:25.361485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] PATH_INFO: `/v3/users/1437edad22b64921a4a4998a98a2a4e1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:25.362683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1437edad22b64921a4a4998a98a2a4e1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:25.364801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:25.573672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:25.576124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1437edad22b64921a4a4998a98a2a4e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.576882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1437edad22b64921a4a4998a98a2a4e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.577529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1437edad22b64921a4a4998a98a2a4e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.629924 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1437edad22b64921a4a4998a98a2a4e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.642428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1437edad22b64921a4a4998a98a2a4e1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:25.657667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1257/2500] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:25 2022] DELETE /identity/v3/users/1437edad22b64921a4a4998a98a2a4e1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:25.937776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:25.939278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:25.964196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a54a78-b4c3-4084-894d-fa39c586a2e4 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:26.026038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:26.026938 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:26.027253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:26.027533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] PATH_INFO: `/v3/projects/9b310263a3924f8a90aef181ca42abc5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:26.028719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b310263a3924f8a90aef181ca42abc5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:26.030725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:26.039692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:26.157750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b310263a3924f8a90aef181ca42abc5', 'request_id': 'req-d461fc3b-c6c8-467b-8471-a2bc476f0875'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.163980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b310263a3924f8a90aef181ca42abc5', 'request_id': 'req-d461fc3b-c6c8-467b-8471-a2bc476f0875'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.267556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b310263a3924f8a90aef181ca42abc5', 'request_id': 'req-d461fc3b-c6c8-467b-8471-a2bc476f0875'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.280270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] The token cache is being invalidate because project 9b310263a3924f8a90aef181ca42abc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:26.280564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.281213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d461fc3b-c6c8-467b-8471-a2bc476f0875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:26.282811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1244/2501] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:25 2022] DELETE /identity/v3/projects/9b310263a3924f8a90aef181ca42abc5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:29.526809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:29.528495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:29.542722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0ba71-5d58-48f9-9848-bc782d946afc admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:29.601330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:29.602208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:29.602485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:29.602754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] PATH_INFO: `/v3/users/a4858887c1534163b137df7473e3a025` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:29.604185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4858887c1534163b137df7473e3a025)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:29.606188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:29.815817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4858887c1534163b137df7473e3a025'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.816465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4858887c1534163b137df7473e3a025'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.817064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4858887c1534163b137df7473e3a025'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.893054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4858887c1534163b137df7473e3a025'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.906484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4858887c1534163b137df7473e3a025'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:29.919657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1258/2502] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:29 2022] DELETE /identity/v3/users/a4858887c1534163b137df7473e3a025 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:07:29.924190 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656c4c-03af-469a-b517-f7bf506200f6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:29.924688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656c4c-03af-469a-b517-f7bf506200f6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:29.924796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab656c4c-03af-469a-b517-f7bf506200f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:29.942324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ab656c4c-03af-469a-b517-f7bf506200f6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:29.943837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ab656c4c-03af-469a-b517-f7bf506200f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:30.005027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1245/2503] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:30.014837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.016247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:30.060354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:30.073947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62516f57-3a78-4884-b9e1-358cd229a73b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.077499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4c663-183c-4612-a3f1-da9085688a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.078168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4c663-183c-4612-a3f1-da9085688a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.078456 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4c663-183c-4612-a3f1-da9085688a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.078729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4c663-183c-4612-a3f1-da9085688a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.088282 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4c663-183c-4612-a3f1-da9085688a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.089974 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4c663-183c-4612-a3f1-da9085688a49 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.100305 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1259/2504] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:30.512330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656c4c-03af-469a-b517-f7bf506200f6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.513759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ab656c4c-03af-469a-b517-f7bf506200f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:30.527620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab656c4c-03af-469a-b517-f7bf506200f6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.532872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.533991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.534262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.534538 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] PATH_INFO: `/v3/projects/627e34f2daff4d678131767118d56533` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.535731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=627e34f2daff4d678131767118d56533)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.538756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.637155 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627e34f2daff4d678131767118d56533', 'request_id': 'req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:30.642622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627e34f2daff4d678131767118d56533', 'request_id': 'req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:30.733590 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627e34f2daff4d678131767118d56533', 'request_id': 'req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:30.745496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] The token cache is being invalidate because project 627e34f2daff4d678131767118d56533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:30.745789 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:30.746513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-cf26b71a-06a3-49b9-bf53-e6c1039f80eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:30.748072 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1246/2505] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:30 2022] DELETE /identity/v3/projects/627e34f2daff4d678131767118d56533 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:30.753016 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c77cd-d8a1-4867-be08-67dc00dd3e8d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.753501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c77cd-d8a1-4867-be08-67dc00dd3e8d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.753600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c77cd-d8a1-4867-be08-67dc00dd3e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.771170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-aa7c77cd-d8a1-4867-be08-67dc00dd3e8d None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:30.773106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aa7c77cd-d8a1-4867-be08-67dc00dd3e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:30.835425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1260/2506] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:30.843018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e1ca-105e-4687-8a37-e649ea70db1c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.843311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e1ca-105e-4687-8a37-e649ea70db1c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.843593 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e1ca-105e-4687-8a37-e649ea70db1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.862901 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fd98e1ca-105e-4687-8a37-e649ea70db1c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:30.864106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fd98e1ca-105e-4687-8a37-e649ea70db1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:30.873104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1247/2507] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:30.877297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c77cd-d8a1-4867-be08-67dc00dd3e8d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.886938 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c77cd-d8a1-4867-be08-67dc00dd3e8d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.891499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.892251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.892536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.892811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.893528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:30.893832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.895444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.907381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1261/2508] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:30.911590 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e1ca-105e-4687-8a37-e649ea70db1c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:30.921557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e1ca-105e-4687-8a37-e649ea70db1c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:30.926239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67828f-cd39-4d3a-99d6-4bdf421c0ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:30.926887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67828f-cd39-4d3a-99d6-4bdf421c0ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:30.927172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67828f-cd39-4d3a-99d6-4bdf421c0ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:30.927455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67828f-cd39-4d3a-99d6-4bdf421c0ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:30.928142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67828f-cd39-4d3a-99d6-4bdf421c0ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:30.930029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67828f-cd39-4d3a-99d6-4bdf421c0ab7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:30.939636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:31.027001 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1248/2509] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:30 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:31.033560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.043864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca767bf-ae36-4383-9cd3-2a07ecc054b9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.102218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35434-3a58-4e26-bb20-e1d34f31df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:31.102895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35434-3a58-4e26-bb20-e1d34f31df60 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.103187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35434-3a58-4e26-bb20-e1d34f31df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.103470 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a35434-3a58-4e26-bb20-e1d34f31df60 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.104425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35434-3a58-4e26-bb20-e1d34f31df60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:31.106357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a35434-3a58-4e26-bb20-e1d34f31df60 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:31.219475 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1262/2510] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:31 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:07:31.223526 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67828f-cd39-4d3a-99d6-4bdf421c0ab7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.234984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67828f-cd39-4d3a-99d6-4bdf421c0ab7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.239969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aaa7d-450a-4af5-9b71-e53f950c6030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:31.240663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aaa7d-450a-4af5-9b71-e53f950c6030 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.240951 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aaa7d-450a-4af5-9b71-e53f950c6030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.241233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aaa7d-450a-4af5-9b71-e53f950c6030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.241963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aaa7d-450a-4af5-9b71-e53f950c6030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:31.243614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aaa7d-450a-4af5-9b71-e53f950c6030 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:31.253556 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1249/2511] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:31.258208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35434-3a58-4e26-bb20-e1d34f31df60 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.268330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a35434-3a58-4e26-bb20-e1d34f31df60 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.274400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f34d5-dd87-4040-bdf0-66f39106416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:31.275061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f34d5-dd87-4040-bdf0-66f39106416a admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.275348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f34d5-dd87-4040-bdf0-66f39106416a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.275627 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f34d5-dd87-4040-bdf0-66f39106416a admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.276381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f34d5-dd87-4040-bdf0-66f39106416a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:31.277963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f34d5-dd87-4040-bdf0-66f39106416a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:31.288799 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1263/2512] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:31.293019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aaa7d-450a-4af5-9b71-e53f950c6030 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.303851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aaa7d-450a-4af5-9b71-e53f950c6030 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.308534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:31.309417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.309728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.310010 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] PATH_INFO: `/v3/projects/232c32821490488ea1511d8515cebab1/users/451a91f03c16404b9e5c4a73483be89a/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.325793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232c32821490488ea1511d8515cebab1, user_id=451a91f03c16404b9e5c4a73483be89a, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:31.328665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:31.393333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1250/2513] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:31 2022] PUT /identity/v3/projects/232c32821490488ea1511d8515cebab1/users/451a91f03c16404b9e5c4a73483be89a/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:31.403543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689031-8b6d-497c-a03d-8e930ed5f538 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.403897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689031-8b6d-497c-a03d-8e930ed5f538 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.404209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689031-8b6d-497c-a03d-8e930ed5f538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.430636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-fa689031-8b6d-497c-a03d-8e930ed5f538 None None] MFA Rules not processed for user `451a91f03c16404b9e5c4a73483be89a`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:31.431835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fa689031-8b6d-497c-a03d-8e930ed5f538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:31.470488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:31.496890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1264/2514] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:31.509093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:31.510855 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:31.569185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ab2a-d4c4-4d8d-9a7c-f65ba23cac93 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:31.572959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:31.573609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:31.573893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:31.574213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:31.582714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:31.584181 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:31.593014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1251/2515] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:32.798224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689031-8b6d-497c-a03d-8e930ed5f538 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:32.799704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fa689031-8b6d-497c-a03d-8e930ed5f538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:32.875713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689031-8b6d-497c-a03d-8e930ed5f538 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:32.881870 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:32.882545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:32.882827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:32.883099 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:32.884872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:32.943981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:32.945548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:32.954632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1265/2516] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:41.589065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:42.950394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=66 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:51.767698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:51.769430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.829940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d0167-2483-4204-a481-6dc8a88ca718 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:51.833589 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7262786-3220-4e09-af09-649881b8c69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:51.834272 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262786-3220-4e09-af09-649881b8c69f service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:51.834563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262786-3220-4e09-af09-649881b8c69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:51.835520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7262786-3220-4e09-af09-649881b8c69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:51.837634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e7262786-3220-4e09-af09-649881b8c69f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:51.902568 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7262786-3220-4e09-af09-649881b8c69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:51.903927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7262786-3220-4e09-af09-649881b8c69f service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:51.912795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1252/2517] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:53.616902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:53.632734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e2fa4-1a14-492e-a3bd-cd97bc0b64f4 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:53.640366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:53.653390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:53.653390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:53.653390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:53.653390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:53.730269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:53.732100 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:53.744251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1266/2518] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:55.905436 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3027a2-2f66-4fce-aaa0-427ec6a6007a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:55.905944 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3027a2-2f66-4fce-aaa0-427ec6a6007a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:55.906052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3027a2-2f66-4fce-aaa0-427ec6a6007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:55.931483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7b3027a2-2f66-4fce-aaa0-427ec6a6007a None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:55.931483 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7b3027a2-2f66-4fce-aaa0-427ec6a6007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.050490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1253/2519] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:07:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:56.069707 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:56.071493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.218598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccb750-130e-4711-b6d6-83c6113b9cd3 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:56.229367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87144c86-599b-47ae-bf55-d54f1bb5a6ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:56.230699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87144c86-599b-47ae-bf55-d54f1bb5a6ff service swift] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:56.231457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87144c86-599b-47ae-bf55-d54f1bb5a6ff service swift] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:56.232073 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87144c86-599b-47ae-bf55-d54f1bb5a6ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:56.240794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3027a2-2f66-4fce-aaa0-427ec6a6007a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:56.272831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3027a2-2f66-4fce-aaa0-427ec6a6007a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:56.280434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87144c86-599b-47ae-bf55-d54f1bb5a6ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:56.284351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87144c86-599b-47ae-bf55-d54f1bb5a6ff service swift] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:56.291784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:56.293893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:56.294212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:56.294496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] PATH_INFO: `/v3/users/451a91f03c16404b9e5c4a73483be89a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:56.297734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1267/2520] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:07:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:07:56.299157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451a91f03c16404b9e5c4a73483be89a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:56.301501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:56.529622 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451a91f03c16404b9e5c4a73483be89a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.531847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451a91f03c16404b9e5c4a73483be89a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.550177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:56.552236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451a91f03c16404b9e5c4a73483be89a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.553119 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451a91f03c16404b9e5c4a73483be89a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.688296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451a91f03c16404b9e5c4a73483be89a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:56.734298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1254/2521] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:56 2022] DELETE /identity/v3/users/451a91f03c16404b9e5c4a73483be89a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:56.739663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b77d9-3cc6-444e-a98a-22740f02f3a4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:56.740129 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b77d9-3cc6-444e-a98a-22740f02f3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:56.740560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b77d9-3cc6-444e-a98a-22740f02f3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:56.769558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-977b77d9-3cc6-444e-a98a-22740f02f3a4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:56.771111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-977b77d9-3cc6-444e-a98a-22740f02f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.896363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:56.899266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:56.903285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1268/2522] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:57.018539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696b04a-47ca-422b-8223-930872b4bde9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:57.026534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97a2c8-007e-41d5-ab8d-e1ebd0477aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:57.028567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a2c8-007e-41d5-ab8d-e1ebd0477aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.028869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a2c8-007e-41d5-ab8d-e1ebd0477aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.029827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97a2c8-007e-41d5-ab8d-e1ebd0477aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.054467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97a2c8-007e-41d5-ab8d-e1ebd0477aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:57.058562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97a2c8-007e-41d5-ab8d-e1ebd0477aa5 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:57.096882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1255/2523] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:57.874899 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b77d9-3cc6-444e-a98a-22740f02f3a4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:57.877340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-977b77d9-3cc6-444e-a98a-22740f02f3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:57.926767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b77d9-3cc6-444e-a98a-22740f02f3a4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:57.930646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:57.934011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:57.935391 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:57.936233 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] PATH_INFO: `/v3/projects/232c32821490488ea1511d8515cebab1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:57.942418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232c32821490488ea1511d8515cebab1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:57.945624 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:57.983101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:58.093580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232c32821490488ea1511d8515cebab1', 'request_id': 'req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.107501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232c32821490488ea1511d8515cebab1', 'request_id': 'req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.114531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232c32821490488ea1511d8515cebab1', 'request_id': 'req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.214730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] The token cache is being invalidate because project 232c32821490488ea1511d8515cebab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:58.215642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.217152 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.219931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1269/2524] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:57 2022] DELETE /identity/v3/projects/232c32821490488ea1511d8515cebab1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:58.228626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069417e-5ccf-4208-a733-9780d37802a4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.229607 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069417e-5ccf-4208-a733-9780d37802a4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.229923 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069417e-5ccf-4208-a733-9780d37802a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.249948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7069417e-5ccf-4208-a733-9780d37802a4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:58.251188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7069417e-5ccf-4208-a733-9780d37802a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:58.333459 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.335855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:58.356769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1256/2525] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:58.356902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551d1f2-f7a2-45cb-9d9f-7f436d731f10 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.359097 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72303a6-4358-4d86-8fd8-3fa2374624f2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.359541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72303a6-4358-4d86-8fd8-3fa2374624f2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.360007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72303a6-4358-4d86-8fd8-3fa2374624f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.371613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.372800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.373322 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.374122 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] PATH_INFO: `/v3/users/cf981e5982644d708ddaba93a12b2b27` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.376652 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf981e5982644d708ddaba93a12b2b27)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.379473 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.406553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c72303a6-4358-4d86-8fd8-3fa2374624f2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:58.406553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c72303a6-4358-4d86-8fd8-3fa2374624f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:58.421689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1257/2526] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:58.426108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72303a6-4358-4d86-8fd8-3fa2374624f2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.438328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72303a6-4358-4d86-8fd8-3fa2374624f2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.443487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.445007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.445513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.445821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.446577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:58.447055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.448852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.465701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1258/2527] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:07:58.470042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.484595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacc6c8-6cbc-43e6-9dde-a2ead71536fb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.488649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c73b3-04c8-4e13-8ee0-24b78f22b258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.489592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c73b3-04c8-4e13-8ee0-24b78f22b258 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.490094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c73b3-04c8-4e13-8ee0-24b78f22b258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.490567 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c73b3-04c8-4e13-8ee0-24b78f22b258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.492142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c73b3-04c8-4e13-8ee0-24b78f22b258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.494304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c73b3-04c8-4e13-8ee0-24b78f22b258 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.661383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1259/2528] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:58 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:58.662434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c73b3-04c8-4e13-8ee0-24b78f22b258 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.680739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf981e5982644d708ddaba93a12b2b27'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.685386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf981e5982644d708ddaba93a12b2b27'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.685386 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf981e5982644d708ddaba93a12b2b27'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.744179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:58.753804 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf981e5982644d708ddaba93a12b2b27'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.804294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf981e5982644d708ddaba93a12b2b27'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:58.817459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c73b3-04c8-4e13-8ee0-24b78f22b258 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.832997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.842002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.842548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.842934 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.843772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:58.845948 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:58.850075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1270/2529] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:07:58 2022] DELETE /identity/v3/users/cf981e5982644d708ddaba93a12b2b27 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:58.852444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.854200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:58.929237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1260/2530] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:07:58 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:07:58.933427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:58.936077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:58.945426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e982-19e4-4aee-8161-94d366086037 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:58.950498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:58.951168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:58.951452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:58.951731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:58.961812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:58.985296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f126593-af80-4942-93b2-5b69e4a3fce7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.074116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:59.105640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.107746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.125359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1271/2531] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:07:59.128994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ddbcf-3d6c-4a7b-b88c-de3a30f75fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.129768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ddbcf-3d6c-4a7b-b88c-de3a30f75fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.130212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ddbcf-3d6c-4a7b-b88c-de3a30f75fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.130553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ddbcf-3d6c-4a7b-b88c-de3a30f75fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.132050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ddbcf-3d6c-4a7b-b88c-de3a30f75fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.133403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ddbcf-3d6c-4a7b-b88c-de3a30f75fa2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.148560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1261/2532] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:07:59.150178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:59.161050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d4738-d4eb-4397-9a29-6c2623a2c7ea service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.171724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.173053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.173413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.174288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.175482 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.177350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.196488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1272/2533] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:07:59.197737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ddbcf-3d6c-4a7b-b88c-de3a30f75fa2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:59.209392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ddbcf-3d6c-4a7b-b88c-de3a30f75fa2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.219253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7226ba0-68aa-4a2d-afc2-15798299710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.220169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ba0-68aa-4a2d-afc2-15798299710e admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.222035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ba0-68aa-4a2d-afc2-15798299710e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.222385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7226ba0-68aa-4a2d-afc2-15798299710e admin admin] PATH_INFO: `/v3/projects/f1c61f56874445e88b3c9b69ec77871f/users/a524c7ab9a79482eb9f54772839c1e32/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.242101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7226ba0-68aa-4a2d-afc2-15798299710e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c61f56874445e88b3c9b69ec77871f, user_id=a524c7ab9a79482eb9f54772839c1e32, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.245689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7226ba0-68aa-4a2d-afc2-15798299710e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.287234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:59.289715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:59.312701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1262/2534] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:07:59 2022] PUT /identity/v3/projects/f1c61f56874445e88b3c9b69ec77871f/users/a524c7ab9a79482eb9f54772839c1e32/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:59.322208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf355f0-4568-4ea2-8171-a584c7814059 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.334093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700652da-0043-4e13-bd91-5739b5d9dcf6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.335153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700652da-0043-4e13-bd91-5739b5d9dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.338309 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700652da-0043-4e13-bd91-5739b5d9dcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.401399 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-700652da-0043-4e13-bd91-5739b5d9dcf6 None None] MFA Rules not processed for user `a524c7ab9a79482eb9f54772839c1e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:59.402816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-700652da-0043-4e13-bd91-5739b5d9dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:59.428394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.430095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.430536 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.431027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] PATH_INFO: `/v3/projects/3c906f2149774a18b39228b7b6ef556f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.432461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c906f2149774a18b39228b7b6ef556f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.434845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.495942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1263/2535] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:59.507096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700652da-0043-4e13-bd91-5739b5d9dcf6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:59.508546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-700652da-0043-4e13-bd91-5739b5d9dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:59.539985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:59.577385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700652da-0043-4e13-bd91-5739b5d9dcf6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.593678 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c906f2149774a18b39228b7b6ef556f', 'request_id': 'req-9885384e-9b9d-4620-b0c7-4690cf8caf25'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:59.605505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c906f2149774a18b39228b7b6ef556f', 'request_id': 'req-9885384e-9b9d-4620-b0c7-4690cf8caf25'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:59.612932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c906f2149774a18b39228b7b6ef556f', 'request_id': 'req-9885384e-9b9d-4620-b0c7-4690cf8caf25'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:59.650142 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d0713-d555-4ae6-a9aa-f950dbb551fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb36ac7a2e4643009bc1b0ca599203f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.651117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d0713-d555-4ae6-a9aa-f950dbb551fa service glance] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.651577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d0713-d555-4ae6-a9aa-f950dbb551fa service glance] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.652014 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d0713-d555-4ae6-a9aa-f950dbb551fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.701480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] The token cache is being invalidate because project 3c906f2149774a18b39228b7b6ef556f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:07:59.706785 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:59.707568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-9885384e-9b9d-4620-b0c7-4690cf8caf25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:07:59.714452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1273/2536] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:07:59 2022] DELETE /identity/v3/projects/3c906f2149774a18b39228b7b6ef556f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:07:59.716902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1a4a2-87a0-4a12-bee1-c6a78ea475a7 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.725781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1a4a2-87a0-4a12-bee1-c6a78ea475a7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.725781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1a4a2-87a0-4a12-bee1-c6a78ea475a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.742654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d0713-d555-4ae6-a9aa-f950dbb551fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.745733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d0713-d555-4ae6-a9aa-f950dbb551fa service glance] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.748185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6ac1a4a2-87a0-4a12-bee1-c6a78ea475a7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:59.749417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6ac1a4a2-87a0-4a12-bee1-c6a78ea475a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:59.761374 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1264/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:07:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:07:59.847397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:07:59.879063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1274/2538] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:07:59.884035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030c69-13ca-4fd0-96c5-eae924742031 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.884035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030c69-13ca-4fd0-96c5-eae924742031 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.884035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f030c69-13ca-4fd0-96c5-eae924742031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.905992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0f030c69-13ca-4fd0-96c5-eae924742031 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:07:59.907366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0f030c69-13ca-4fd0-96c5-eae924742031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:07:59.918792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1265/2539] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:07:59.922782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1a4a2-87a0-4a12-bee1-c6a78ea475a7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:07:59.939491 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1a4a2-87a0-4a12-bee1-c6a78ea475a7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:07:59.956331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:07:59.956331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:07:59.957092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:07:59.957092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:07:59.959086 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:07:59.960784 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:07:59.965688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:07:59.996113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1275/2540] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:00.000682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f030c69-13ca-4fd0-96c5-eae924742031 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:00.016212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f030c69-13ca-4fd0-96c5-eae924742031 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:00.026210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2f250-63a3-44cc-9bee-ef6016c39f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:00.027042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f250-63a3-44cc-9bee-ef6016c39f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:00.027331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f250-63a3-44cc-9bee-ef6016c39f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:00.027610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2f250-63a3-44cc-9bee-ef6016c39f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:00.034729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2f250-63a3-44cc-9bee-ef6016c39f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:00.036705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2f250-63a3-44cc-9bee-ef6016c39f1f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:00.183188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1266/2541] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:07:59 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:00.185131 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:00.197923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837f8a6-2ed7-47a2-9c85-99eff53070f2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:00.312379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6865a7-51e2-456d-bbff-70849841866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:00.313126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6865a7-51e2-456d-bbff-70849841866b admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:00.313414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6865a7-51e2-456d-bbff-70849841866b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:00.313692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6865a7-51e2-456d-bbff-70849841866b admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:00.314466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6865a7-51e2-456d-bbff-70849841866b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:00.316476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6865a7-51e2-456d-bbff-70849841866b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:00.423596 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1276/2542] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:00 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:00.428389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2f250-63a3-44cc-9bee-ef6016c39f1f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:00.440184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2f250-63a3-44cc-9bee-ef6016c39f1f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:00.450689 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1fbfa-6584-42f8-8c2c-a9619ef31121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:00.451679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1fbfa-6584-42f8-8c2c-a9619ef31121 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:00.451840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1fbfa-6584-42f8-8c2c-a9619ef31121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:00.456891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1fbfa-6584-42f8-8c2c-a9619ef31121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:00.456891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1fbfa-6584-42f8-8c2c-a9619ef31121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:00.456891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f1fbfa-6584-42f8-8c2c-a9619ef31121 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:00.467338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1267/2543] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:00.471568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6865a7-51e2-456d-bbff-70849841866b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:00.484351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6865a7-51e2-456d-bbff-70849841866b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:00.489284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14100a5f-4f7f-415a-b6f3-c6ce9f60c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:00.489973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14100a5f-4f7f-415a-b6f3-c6ce9f60c183 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:00.492397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14100a5f-4f7f-415a-b6f3-c6ce9f60c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:00.492397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14100a5f-4f7f-415a-b6f3-c6ce9f60c183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:00.492397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14100a5f-4f7f-415a-b6f3-c6ce9f60c183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:00.493920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14100a5f-4f7f-415a-b6f3-c6ce9f60c183 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:00.505486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1277/2544] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:00.509849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1fbfa-6584-42f8-8c2c-a9619ef31121 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:00.527959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1fbfa-6584-42f8-8c2c-a9619ef31121 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:00.532929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da0110-ae1d-4049-9f3f-192835d6b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:00.533860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0110-ae1d-4049-9f3f-192835d6b4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:00.534254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0110-ae1d-4049-9f3f-192835d6b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:00.534553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da0110-ae1d-4049-9f3f-192835d6b4a0 admin admin] PATH_INFO: `/v3/projects/1bfa2ebab8e446f88e269982d78eb49e/users/57e79338c68a4b238a3155f72bb79e23/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:00.551751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da0110-ae1d-4049-9f3f-192835d6b4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfa2ebab8e446f88e269982d78eb49e, user_id=57e79338c68a4b238a3155f72bb79e23, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:00.554788 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da0110-ae1d-4049-9f3f-192835d6b4a0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:01.092237 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1268/2545] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:00 2022] PUT /identity/v3/projects/1bfa2ebab8e446f88e269982d78eb49e/users/57e79338c68a4b238a3155f72bb79e23/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:01.102533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f108d-c8c6-49f9-96fe-105818b0a617 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:01.103060 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f108d-c8c6-49f9-96fe-105818b0a617 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:01.103704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f108d-c8c6-49f9-96fe-105818b0a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:01.138571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-b86f108d-c8c6-49f9-96fe-105818b0a617 None None] MFA Rules not processed for user `57e79338c68a4b238a3155f72bb79e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:01.139759 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b86f108d-c8c6-49f9-96fe-105818b0a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:01.256120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1278/2546] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:01.260784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da0110-ae1d-4049-9f3f-192835d6b4a0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:01.319629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:01.381906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da0110-ae1d-4049-9f3f-192835d6b4a0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:01.389935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465acb1d-c72b-4975-a6c2-2735d916d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:01.390723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb1d-c72b-4975-a6c2-2735d916d2ef admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:01.391016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb1d-c72b-4975-a6c2-2735d916d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:01.391991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb1d-c72b-4975-a6c2-2735d916d2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:01.393348 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465acb1d-c72b-4975-a6c2-2735d916d2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:01.396098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465acb1d-c72b-4975-a6c2-2735d916d2ef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:01.507949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1269/2547] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:01 2022] POST /identity/v3/projects => generated 365 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:01.510515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f108d-c8c6-49f9-96fe-105818b0a617 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:01.521815 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f108d-c8c6-49f9-96fe-105818b0a617 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:01.579539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:01.607875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d877-7ab3-4e20-a28e-abd8a967f478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:01.608771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d877-7ab3-4e20-a28e-abd8a967f478 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:01.609138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d877-7ab3-4e20-a28e-abd8a967f478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:01.609673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8d877-7ab3-4e20-a28e-abd8a967f478 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:01.610670 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8d877-7ab3-4e20-a28e-abd8a967f478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:01.613283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8d877-7ab3-4e20-a28e-abd8a967f478 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:01.730978 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1279/2548] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:01 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:01.734731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465acb1d-c72b-4975-a6c2-2735d916d2ef admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:01.750034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465acb1d-c72b-4975-a6c2-2735d916d2ef admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:01.759579 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7253-8639-4ad7-91dc-e1366735335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:01.767369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7253-8639-4ad7-91dc-e1366735335f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:01.767369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7253-8639-4ad7-91dc-e1366735335f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:01.767369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb7253-8639-4ad7-91dc-e1366735335f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:01.767369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb7253-8639-4ad7-91dc-e1366735335f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:01.767369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb7253-8639-4ad7-91dc-e1366735335f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:01.791259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1270/2549] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:01.795269 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d877-7ab3-4e20-a28e-abd8a967f478 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:01.809935 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8d877-7ab3-4e20-a28e-abd8a967f478 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:01.822394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11728-9e1f-4f05-a25e-69f9bb43304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:01.822394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11728-9e1f-4f05-a25e-69f9bb43304f admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:01.822394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11728-9e1f-4f05-a25e-69f9bb43304f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:01.822394 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11728-9e1f-4f05-a25e-69f9bb43304f admin admin] PATH_INFO: `/v3/projects/7aac81b77f5946f982ed0d0b8412b9ff/users/c5fbd893d3bb42af9de274c2c9790fd6/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:01.843998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff11728-9e1f-4f05-a25e-69f9bb43304f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aac81b77f5946f982ed0d0b8412b9ff, user_id=c5fbd893d3bb42af9de274c2c9790fd6, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:01.847164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff11728-9e1f-4f05-a25e-69f9bb43304f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:01.925185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1280/2550] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:01 2022] PUT /identity/v3/projects/7aac81b77f5946f982ed0d0b8412b9ff/users/c5fbd893d3bb42af9de274c2c9790fd6/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:01.931065 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7253-8639-4ad7-91dc-e1366735335f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:01.949784 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb7253-8639-4ad7-91dc-e1366735335f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:02.055157 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4029f94-5bf1-431f-96ab-f5cfb10d3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:02.056085 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4029f94-5bf1-431f-96ab-f5cfb10d3fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:02.056445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4029f94-5bf1-431f-96ab-f5cfb10d3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:02.056921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4029f94-5bf1-431f-96ab-f5cfb10d3fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:02.057851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4029f94-5bf1-431f-96ab-f5cfb10d3fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:02.059596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4029f94-5bf1-431f-96ab-f5cfb10d3fa0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:02.079063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1271/2551] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:02.083887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11728-9e1f-4f05-a25e-69f9bb43304f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:02.099548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11728-9e1f-4f05-a25e-69f9bb43304f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:02.105847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:02.106928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:02.107210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:02.107486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] PATH_INFO: `/v3/projects/7aac81b77f5946f982ed0d0b8412b9ff/users/c5fbd893d3bb42af9de274c2c9790fd6/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:02.110489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aac81b77f5946f982ed0d0b8412b9ff, user_id=c5fbd893d3bb42af9de274c2c9790fd6, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:02.114753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:02.156241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1281/2552] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:02 2022] PUT /identity/v3/projects/7aac81b77f5946f982ed0d0b8412b9ff/users/c5fbd893d3bb42af9de274c2c9790fd6/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:02.169126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72085dae-7d34-4734-87de-7f7b0262290a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:02.169421 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72085dae-7d34-4734-87de-7f7b0262290a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:02.169705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72085dae-7d34-4734-87de-7f7b0262290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:02.211687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-72085dae-7d34-4734-87de-7f7b0262290a None None] MFA Rules not processed for user `c5fbd893d3bb42af9de274c2c9790fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:02.213881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-72085dae-7d34-4734-87de-7f7b0262290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:02.366632 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1272/2553] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:02.380651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:02.383880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:02.461147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec6e1c-817e-4247-a309-bbe5ba4b172a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:02.477512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530ae4e-d9b4-4785-a902-4ff4ec0032be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:02.479330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ae4e-d9b4-4785-a902-4ff4ec0032be service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:02.479802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ae4e-d9b4-4785-a902-4ff4ec0032be service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:02.480243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530ae4e-d9b4-4785-a902-4ff4ec0032be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:02.526510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530ae4e-d9b4-4785-a902-4ff4ec0032be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:02.533164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530ae4e-d9b4-4785-a902-4ff4ec0032be service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:02.568540 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1282/2554] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:02.871792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72085dae-7d34-4734-87de-7f7b0262290a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:02.886266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72085dae-7d34-4734-87de-7f7b0262290a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:02.891637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd3467-f8a2-456a-9007-8558ce0f3b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:02.892383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd3467-f8a2-456a-9007-8558ce0f3b3d service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:02.892665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd3467-f8a2-456a-9007-8558ce0f3b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:02.892957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd3467-f8a2-456a-9007-8558ce0f3b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:02.961150 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:03.036122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd3467-f8a2-456a-9007-8558ce0f3b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:03.040178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd3467-f8a2-456a-9007-8558ce0f3b3d service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:03.095946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1273/2555] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:07.638258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530ae4e-d9b4-4785-a902-4ff4ec0032be service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:07.817964 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530ae4e-d9b4-4785-a902-4ff4ec0032be service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:07.827076 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:07.828173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:07.828561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:07.829035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] PATH_INFO: `/v3/users/57e79338c68a4b238a3155f72bb79e23` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:07.832864 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e79338c68a4b238a3155f72bb79e23)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:07.840835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:08.112378 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:08.121711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e79338c68a4b238a3155f72bb79e23'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:08.122813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e79338c68a4b238a3155f72bb79e23'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:08.123888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e79338c68a4b238a3155f72bb79e23'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:08.205780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e79338c68a4b238a3155f72bb79e23'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:08.233334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e79338c68a4b238a3155f72bb79e23'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:08.262932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1283/2556] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:07 2022] DELETE /identity/v3/users/57e79338c68a4b238a3155f72bb79e23 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:08.264854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958960fd-5797-49bc-a3bf-4cf5cba35a0c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:08.265335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958960fd-5797-49bc-a3bf-4cf5cba35a0c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:08.265445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958960fd-5797-49bc-a3bf-4cf5cba35a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:08.292471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-958960fd-5797-49bc-a3bf-4cf5cba35a0c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:08.293728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-958960fd-5797-49bc-a3bf-4cf5cba35a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:08.399255 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1274/2557] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:08.409495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:08.411247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:08.497887 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42f7b9-c717-452c-829f-636b10ab49b8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:08.502910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:08.503893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:08.504525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:08.504890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:08.544167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:08.546027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:08.559454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1284/2558] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:09.368284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958960fd-5797-49bc-a3bf-4cf5cba35a0c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:09.368879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-958960fd-5797-49bc-a3bf-4cf5cba35a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:09.383955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958960fd-5797-49bc-a3bf-4cf5cba35a0c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:09.414898 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:09.415808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:09.416147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:09.416432 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] PATH_INFO: `/v3/projects/1bfa2ebab8e446f88e269982d78eb49e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:09.417853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfa2ebab8e446f88e269982d78eb49e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:09.419956 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:09.538114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:09.547440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:09.570455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7b997-08ce-4155-b87a-811a0e897f3f service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:09.591049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfa2ebab8e446f88e269982d78eb49e', 'request_id': 'req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.598203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfa2ebab8e446f88e269982d78eb49e', 'request_id': 'req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:09.657458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:09.658698 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:09.659093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:09.659460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] PATH_INFO: `/v3/users/9e9848da15ea4ddfbceaf556423ba852` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:09.663424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9848da15ea4ddfbceaf556423ba852)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:09.665495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:10.102209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfa2ebab8e446f88e269982d78eb49e', 'request_id': 'req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.114798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] The token cache is being invalidate because project 1bfa2ebab8e446f88e269982d78eb49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:10.115095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.115829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.117499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1275/2559] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:09 2022] DELETE /identity/v3/projects/1bfa2ebab8e446f88e269982d78eb49e => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:10.124874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:10.126360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:10.141465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a23f0-dd1b-4f2b-92a7-1a6b1e801595 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:10.147834 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:10.148906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:10.149296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:10.149583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] PATH_INFO: `/v3/users/c5fbd893d3bb42af9de274c2c9790fd6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:10.154906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fbd893d3bb42af9de274c2c9790fd6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:10.154906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:10.216607 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9848da15ea4ddfbceaf556423ba852'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.217318 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9848da15ea4ddfbceaf556423ba852'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.217976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9848da15ea4ddfbceaf556423ba852'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.307017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9848da15ea4ddfbceaf556423ba852'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.315676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:10.321937 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9848da15ea4ddfbceaf556423ba852'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.341297 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1285/2560] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:09 2022] DELETE /identity/v3/users/9e9848da15ea4ddfbceaf556423ba852 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:10.375941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:10.379394 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fbd893d3bb42af9de274c2c9790fd6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.380082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fbd893d3bb42af9de274c2c9790fd6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.389590 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fbd893d3bb42af9de274c2c9790fd6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.390415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fbd893d3bb42af9de274c2c9790fd6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.472989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fbd893d3bb42af9de274c2c9790fd6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:10.501236 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1276/2561] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:10 2022] DELETE /identity/v3/users/c5fbd893d3bb42af9de274c2c9790fd6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:10.743565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:10.745692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:10.844187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5362c2f-2896-4fdf-aa7b-a822aaa60939 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:10.962039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:10.963320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:10.963621 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:10.963929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] PATH_INFO: `/v3/projects/88cc58068dc749479b723b40a455c8c3` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:10.965390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cc58068dc749479b723b40a455c8c3)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:10.968018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.154259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cc58068dc749479b723b40a455c8c3', 'request_id': 'req-1ec6a9f9-adf4-4221-b428-cac8877e2c93'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.160541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cc58068dc749479b723b40a455c8c3', 'request_id': 'req-1ec6a9f9-adf4-4221-b428-cac8877e2c93'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.166571 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cc58068dc749479b723b40a455c8c3', 'request_id': 'req-1ec6a9f9-adf4-4221-b428-cac8877e2c93'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.196264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.197704 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.214314 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be18197-8c92-4ecf-b2c0-439112a16380 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.266810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] The token cache is being invalidate because project 88cc58068dc749479b723b40a455c8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:11.267114 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.267744 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.269471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1286/2562] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:10 2022] DELETE /identity/v3/projects/88cc58068dc749479b723b40a455c8c3 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:11.273903 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.275259 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.279038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.279915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.280189 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.280466 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] PATH_INFO: `/v3/projects/7aac81b77f5946f982ed0d0b8412b9ff` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.281640 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aac81b77f5946f982ed0d0b8412b9ff)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:11.283623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.287969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6a9f9-adf4-4221-b428-cac8877e2c93 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.293059 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.294123 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.294431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.294713 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] PATH_INFO: `/v3/users/30969bf8949f4f8793a0003096c939cd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.295973 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30969bf8949f4f8793a0003096c939cd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:11.305918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.310890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:11.386417 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aac81b77f5946f982ed0d0b8412b9ff', 'request_id': 'req-3f882181-45ec-4f50-9a43-6d84f111552c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.392552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aac81b77f5946f982ed0d0b8412b9ff', 'request_id': 'req-3f882181-45ec-4f50-9a43-6d84f111552c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.495366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aac81b77f5946f982ed0d0b8412b9ff', 'request_id': 'req-3f882181-45ec-4f50-9a43-6d84f111552c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.508321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] The token cache is being invalidate because project 7aac81b77f5946f982ed0d0b8412b9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:11.508924 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.509598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3f882181-45ec-4f50-9a43-6d84f111552c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.511280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1277/2563] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:11 2022] DELETE /identity/v3/projects/7aac81b77f5946f982ed0d0b8412b9ff => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:11.516008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ae50e-9dea-449a-9ef7-bb3eb86a8c9a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.516412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ae50e-9dea-449a-9ef7-bb3eb86a8c9a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.516582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ae50e-9dea-449a-9ef7-bb3eb86a8c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.535392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bb3ae50e-9dea-449a-9ef7-bb3eb86a8c9a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:11.536651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bb3ae50e-9dea-449a-9ef7-bb3eb86a8c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.538320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30969bf8949f4f8793a0003096c939cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.538999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30969bf8949f4f8793a0003096c939cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.539807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30969bf8949f4f8793a0003096c939cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.585791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:11.599889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1278/2564] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:11.607959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f54ef-c591-4ce3-8c7a-1d1454d2c259 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.618209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f54ef-c591-4ce3-8c7a-1d1454d2c259 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.618209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f54ef-c591-4ce3-8c7a-1d1454d2c259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.627152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8f3f54ef-c591-4ce3-8c7a-1d1454d2c259 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:11.628458 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8f3f54ef-c591-4ce3-8c7a-1d1454d2c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.633396 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30969bf8949f4f8793a0003096c939cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.638888 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1279/2565] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:11.643196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f54ef-c591-4ce3-8c7a-1d1454d2c259 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.651686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30969bf8949f4f8793a0003096c939cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:11.654252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f54ef-c591-4ce3-8c7a-1d1454d2c259 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.659735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.660383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.660663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.660940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.661659 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:11.661965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:11.664709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.665172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1287/2566] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:11 2022] DELETE /identity/v3/users/30969bf8949f4f8793a0003096c939cd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:11.676856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1280/2567] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:08:11.682679 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.756409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34e36-f1c5-4e89-b02f-087d5e7a6400 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.761913 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.762620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.762910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.763254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.767502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:11.767502 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.851952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1288/2568] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:11 2022] POST /identity/v3/projects => generated 401 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:11.856406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.866984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbb777-f76f-49b2-8e58-fdcbe9669a96 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.908159 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:11.910013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:11.930442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ad729-5318-44d9-9061-37fe67ab23d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.931486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ad729-5318-44d9-9061-37fe67ab23d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.931486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ad729-5318-44d9-9061-37fe67ab23d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.933057 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ad729-5318-44d9-9061-37fe67ab23d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.933057 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ad729-5318-44d9-9061-37fe67ab23d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:11.934588 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ad729-5318-44d9-9061-37fe67ab23d7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:11.991064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f433-5a72-469c-a43f-064ae570d454 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:11.995885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:11.996820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:11.997135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:11.997414 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] PATH_INFO: `/v3/projects/ccea29c3839345c2b8f3726ea2100bed` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:11.998656 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccea29c3839345c2b8f3726ea2100bed)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.000569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.021352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:12.046099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1281/2569] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:11 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:12.048133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ad729-5318-44d9-9061-37fe67ab23d7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.058446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ad729-5318-44d9-9061-37fe67ab23d7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.063331 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e07da-3b0a-4c97-9edd-4693ab374c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.064002 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e07da-3b0a-4c97-9edd-4693ab374c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.064284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e07da-3b0a-4c97-9edd-4693ab374c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.064558 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e07da-3b0a-4c97-9edd-4693ab374c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.065339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e07da-3b0a-4c97-9edd-4693ab374c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.068076 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e07da-3b0a-4c97-9edd-4693ab374c88 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.080698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1282/2570] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:12.085596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e07da-3b0a-4c97-9edd-4693ab374c88 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.096148 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e07da-3b0a-4c97-9edd-4693ab374c88 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.101854 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2b744-0c6d-4837-91ac-7d7490a6e13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.102569 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b744-0c6d-4837-91ac-7d7490a6e13d admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.102867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b744-0c6d-4837-91ac-7d7490a6e13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.103406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2b744-0c6d-4837-91ac-7d7490a6e13d admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.104170 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2b744-0c6d-4837-91ac-7d7490a6e13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.106992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2b744-0c6d-4837-91ac-7d7490a6e13d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.120619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1283/2571] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:12.124434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2b744-0c6d-4837-91ac-7d7490a6e13d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.138173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2b744-0c6d-4837-91ac-7d7490a6e13d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.138426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccea29c3839345c2b8f3726ea2100bed', 'request_id': 'req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:12.145648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccea29c3839345c2b8f3726ea2100bed', 'request_id': 'req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:12.155486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccea29c3839345c2b8f3726ea2100bed', 'request_id': 'req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:12.210358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.211384 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.211769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.212156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] PATH_INFO: `/v3/projects/69002c78507749c590139f2a89547c1d/users/b8c776713fb14702907c57c5328b6d0b/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.231756 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69002c78507749c590139f2a89547c1d, user_id=b8c776713fb14702907c57c5328b6d0b, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.234442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.258000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] The token cache is being invalidate because project ccea29c3839345c2b8f3726ea2100bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:12.258000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:12.258000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ec6bc74b-3a41-46e3-a4b1-8b5caa317485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:12.259148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1289/2572] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:11 2022] DELETE /identity/v3/projects/ccea29c3839345c2b8f3726ea2100bed => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:12.311008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1284/2573] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:12 2022] PUT /identity/v3/projects/69002c78507749c590139f2a89547c1d/users/b8c776713fb14702907c57c5328b6d0b/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:12.322397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21939c3-0091-46af-9286-603539a01303 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.322871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21939c3-0091-46af-9286-603539a01303 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.323254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21939c3-0091-46af-9286-603539a01303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.356866 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f21939c3-0091-46af-9286-603539a01303 None None] MFA Rules not processed for user `b8c776713fb14702907c57c5328b6d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:12.358186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f21939c3-0091-46af-9286-603539a01303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:12.436936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1290/2574] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:12.441815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.444204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:12.475858 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:12.520679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abb60b-4abf-498d-b305-f7b4af083141 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.526486 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529594ca-5c31-4a80-a2da-f5568542f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.529917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529594ca-5c31-4a80-a2da-f5568542f0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.529917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529594ca-5c31-4a80-a2da-f5568542f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.529917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529594ca-5c31-4a80-a2da-f5568542f0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.529917 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529594ca-5c31-4a80-a2da-f5568542f0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.530473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529594ca-5c31-4a80-a2da-f5568542f0b2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.629164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1285/2575] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/projects => generated 401 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:12.633962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21939c3-0091-46af-9286-603539a01303 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.646020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21939c3-0091-46af-9286-603539a01303 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.706021 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e50426-dddd-4312-9512-1880117735d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.706929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50426-dddd-4312-9512-1880117735d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.707127 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50426-dddd-4312-9512-1880117735d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.707406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e50426-dddd-4312-9512-1880117735d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.708112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e50426-dddd-4312-9512-1880117735d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.710838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e50426-dddd-4312-9512-1880117735d5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.777694 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1291/2576] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:12 2022] POST /identity/v3/users => generated 307 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:12.778605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529594ca-5c31-4a80-a2da-f5568542f0b2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.789813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529594ca-5c31-4a80-a2da-f5568542f0b2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.794692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd4373-6c8d-4d1b-a1f3-e91cf9c79514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.795375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd4373-6c8d-4d1b-a1f3-e91cf9c79514 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.795681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd4373-6c8d-4d1b-a1f3-e91cf9c79514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.795961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd4373-6c8d-4d1b-a1f3-e91cf9c79514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.796702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd4373-6c8d-4d1b-a1f3-e91cf9c79514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.798338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd4373-6c8d-4d1b-a1f3-e91cf9c79514 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.809766 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1286/2577] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:12.814592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e50426-dddd-4312-9512-1880117735d5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.826124 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e50426-dddd-4312-9512-1880117735d5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:12.831027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfe46c-d535-42b8-a6fe-d32888237881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:12.831917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe46c-d535-42b8-a6fe-d32888237881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:12.832198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe46c-d535-42b8-a6fe-d32888237881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:12.832474 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfe46c-d535-42b8-a6fe-d32888237881 admin admin] PATH_INFO: `/v3/projects/75942d8ffb374ce593c8905e8edbd3c0/users/ebc357845a25498bbfd7fe8e22536977/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:12.849118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfe46c-d535-42b8-a6fe-d32888237881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75942d8ffb374ce593c8905e8edbd3c0, user_id=ebc357845a25498bbfd7fe8e22536977, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:12.852155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfe46c-d535-42b8-a6fe-d32888237881 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:12.914940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:12.920034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1292/2578] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:12 2022] PUT /identity/v3/projects/75942d8ffb374ce593c8905e8edbd3c0/users/ebc357845a25498bbfd7fe8e22536977/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:12.930571 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd4373-6c8d-4d1b-a1f3-e91cf9c79514 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:12.940712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd4373-6c8d-4d1b-a1f3-e91cf9c79514 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.000692 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ed2b-f67f-4dec-a170-6b2febf71074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.001375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ed2b-f67f-4dec-a170-6b2febf71074 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.001687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ed2b-f67f-4dec-a170-6b2febf71074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.001979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ed2b-f67f-4dec-a170-6b2febf71074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.002751 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ed2b-f67f-4dec-a170-6b2febf71074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.004434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ed2b-f67f-4dec-a170-6b2febf71074 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.015736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1287/2579] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:13.020495 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfe46c-d535-42b8-a6fe-d32888237881 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.031211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfe46c-d535-42b8-a6fe-d32888237881 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.037518 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.038426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.038709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.039081 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] PATH_INFO: `/v3/projects/75942d8ffb374ce593c8905e8edbd3c0/users/ebc357845a25498bbfd7fe8e22536977/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.041156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75942d8ffb374ce593c8905e8edbd3c0, user_id=ebc357845a25498bbfd7fe8e22536977, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.043850 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.056506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1293/2580] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:13 2022] PUT /identity/v3/projects/75942d8ffb374ce593c8905e8edbd3c0/users/ebc357845a25498bbfd7fe8e22536977/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:13.068024 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89716a21-6d21-4978-a406-9663a1e0e777 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.068316 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89716a21-6d21-4978-a406-9663a1e0e777 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.068601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89716a21-6d21-4978-a406-9663a1e0e777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.102662 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-89716a21-6d21-4978-a406-9663a1e0e777 None None] MFA Rules not processed for user `ebc357845a25498bbfd7fe8e22536977`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:13.104138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-89716a21-6d21-4978-a406-9663a1e0e777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:13.183220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1288/2581] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:13.194005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.196621 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:13.267576 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadfe22-dcb9-424a-949f-d907bb46bb5a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.271346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cc258-b8af-4c2d-94e9-978fdc323570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.271998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc258-b8af-4c2d-94e9-978fdc323570 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.272279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc258-b8af-4c2d-94e9-978fdc323570 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.272553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc258-b8af-4c2d-94e9-978fdc323570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.283019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cc258-b8af-4c2d-94e9-978fdc323570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.284363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cc258-b8af-4c2d-94e9-978fdc323570 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.295214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1294/2582] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:13.510515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89716a21-6d21-4978-a406-9663a1e0e777 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:13.520031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89716a21-6d21-4978-a406-9663a1e0e777 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:13.523840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff19cf-49c3-40a0-8e9b-dcf9bbb1c2e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:13.524477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff19cf-49c3-40a0-8e9b-dcf9bbb1c2e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:13.524759 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff19cf-49c3-40a0-8e9b-dcf9bbb1c2e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:13.525033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff19cf-49c3-40a0-8e9b-dcf9bbb1c2e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:13.540226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:13.585574 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff19cf-49c3-40a0-8e9b-dcf9bbb1c2e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:13.587658 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff19cf-49c3-40a0-8e9b-dcf9bbb1c2e4 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:13.597604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1289/2583] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:19.090615 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cc258-b8af-4c2d-94e9-978fdc323570 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.167539 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cc258-b8af-4c2d-94e9-978fdc323570 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.172826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.173689 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.174050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.174359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] PATH_INFO: `/v3/users/b8c776713fb14702907c57c5328b6d0b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.175530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c776713fb14702907c57c5328b6d0b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.177424 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:19.355445 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c776713fb14702907c57c5328b6d0b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:19.356101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c776713fb14702907c57c5328b6d0b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:19.356712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c776713fb14702907c57c5328b6d0b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:19.430148 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c776713fb14702907c57c5328b6d0b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:19.443704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c776713fb14702907c57c5328b6d0b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:19.456961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1295/2584] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:19 2022] DELETE /identity/v3/users/b8c776713fb14702907c57c5328b6d0b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:19.461581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789cd3-c7bf-42d5-a3b7-d1df351d3895 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.462045 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789cd3-c7bf-42d5-a3b7-d1df351d3895 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.462197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42789cd3-c7bf-42d5-a3b7-d1df351d3895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.481365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-42789cd3-c7bf-42d5-a3b7-d1df351d3895 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:19.482624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-42789cd3-c7bf-42d5-a3b7-d1df351d3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:19.545356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1290/2585] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:19.556128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:19.557710 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:19.568909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:19.618665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35064b-1448-4fe0-b6c7-64df63a6d9f6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:19.622344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf362a9b-368c-44fa-adc8-307b7941169e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:19.622989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf362a9b-368c-44fa-adc8-307b7941169e service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:19.623263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf362a9b-368c-44fa-adc8-307b7941169e service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:19.623542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf362a9b-368c-44fa-adc8-307b7941169e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:19.633730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf362a9b-368c-44fa-adc8-307b7941169e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:19.635190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf362a9b-368c-44fa-adc8-307b7941169e service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:19.644961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1296/2586] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:20.131524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789cd3-c7bf-42d5-a3b7-d1df351d3895 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:20.132740 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-42789cd3-c7bf-42d5-a3b7-d1df351d3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:20.146191 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42789cd3-c7bf-42d5-a3b7-d1df351d3895 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:20.150943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:20.151818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.152104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.152385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] PATH_INFO: `/v3/projects/69002c78507749c590139f2a89547c1d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.153708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69002c78507749c590139f2a89547c1d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:20.156457 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.284767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69002c78507749c590139f2a89547c1d', 'request_id': 'req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.290248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69002c78507749c590139f2a89547c1d', 'request_id': 'req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.349663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69002c78507749c590139f2a89547c1d', 'request_id': 'req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.361637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] The token cache is being invalidate because project 69002c78507749c590139f2a89547c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:20.361919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.362596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.364128 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1291/2587] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:20 2022] DELETE /identity/v3/projects/69002c78507749c590139f2a89547c1d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:20.368200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf362a9b-368c-44fa-adc8-307b7941169e service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:20.380588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf362a9b-368c-44fa-adc8-307b7941169e service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:20.434996 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:20.435868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:20.436157 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:20.436969 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] PATH_INFO: `/v3/users/ebc357845a25498bbfd7fe8e22536977` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:20.438452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc357845a25498bbfd7fe8e22536977)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:20.440388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:20.598093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc357845a25498bbfd7fe8e22536977'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.598739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc357845a25498bbfd7fe8e22536977'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.599334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc357845a25498bbfd7fe8e22536977'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.664546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc357845a25498bbfd7fe8e22536977'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.678108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-6655b138-3442-446b-8ad9-d2596d54445e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc357845a25498bbfd7fe8e22536977'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:20.691717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1297/2588] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:20 2022] DELETE /identity/v3/users/ebc357845a25498bbfd7fe8e22536977 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:21.173068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.175141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:21.188886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c3b06-2bc5-4a56-a2f0-f2cfb4aeda80 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:21.233213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:21.252262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:21.253125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.253411 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.253688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] PATH_INFO: `/v3/projects/75942d8ffb374ce593c8905e8edbd3c0` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.254912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75942d8ffb374ce593c8905e8edbd3c0)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:21.260663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:21.381638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75942d8ffb374ce593c8905e8edbd3c0', 'request_id': 'req-21b793c9-4136-43c1-ae3d-22e9d9773991'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.386905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75942d8ffb374ce593c8905e8edbd3c0', 'request_id': 'req-21b793c9-4136-43c1-ae3d-22e9d9773991'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.447033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75942d8ffb374ce593c8905e8edbd3c0', 'request_id': 'req-21b793c9-4136-43c1-ae3d-22e9d9773991'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.461419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] The token cache is being invalidate because project 75942d8ffb374ce593c8905e8edbd3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:21.461419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.461419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-21b793c9-4136-43c1-ae3d-22e9d9773991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:21.462781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1292/2589] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:21 2022] DELETE /identity/v3/projects/75942d8ffb374ce593c8905e8edbd3c0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:21.468458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9052-ac74-45e7-b9e5-5759f4bc5d7f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.468942 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9052-ac74-45e7-b9e5-5759f4bc5d7f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.469223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9052-ac74-45e7-b9e5-5759f4bc5d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.487450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-5b4b9052-ac74-45e7-b9e5-5759f4bc5d7f None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:21.488686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5b4b9052-ac74-45e7-b9e5-5759f4bc5d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:21.517189 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:21.553833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1298/2590] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:21.561699 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de896bbd-9cdf-4ba3-9084-aec40104b78e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.561998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de896bbd-9cdf-4ba3-9084-aec40104b78e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.565993 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de896bbd-9cdf-4ba3-9084-aec40104b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.582273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-de896bbd-9cdf-4ba3-9084-aec40104b78e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:21.583562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-de896bbd-9cdf-4ba3-9084-aec40104b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:21.591620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1293/2591] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:21.596914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9052-ac74-45e7-b9e5-5759f4bc5d7f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.606946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9052-ac74-45e7-b9e5-5759f4bc5d7f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:21.612111 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:21.612774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.613055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.613329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.614053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:21.614399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:21.615986 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:21.627929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1299/2592] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:21.632230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de896bbd-9cdf-4ba3-9084-aec40104b78e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.642595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de896bbd-9cdf-4ba3-9084-aec40104b78e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:21.647620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1840e-47ff-4354-a4e1-83ac11eb6b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:21.651362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1840e-47ff-4354-a4e1-83ac11eb6b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.651362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1840e-47ff-4354-a4e1-83ac11eb6b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.651362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1840e-47ff-4354-a4e1-83ac11eb6b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.651362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1840e-47ff-4354-a4e1-83ac11eb6b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:21.651709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1840e-47ff-4354-a4e1-83ac11eb6b59 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:21.726110 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1294/2593] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:21 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:08:21.730334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.740796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6fcc1-e83e-4aaa-a92c-926c4a392cde admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:21.797030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb14b4-353f-4a8b-9d05-fbabf8dd4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:21.797758 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb14b4-353f-4a8b-9d05-fbabf8dd4364 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.798106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb14b4-353f-4a8b-9d05-fbabf8dd4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.798485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb14b4-353f-4a8b-9d05-fbabf8dd4364 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.799223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb14b4-353f-4a8b-9d05-fbabf8dd4364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:21.801235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb14b4-353f-4a8b-9d05-fbabf8dd4364 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:21.893845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1300/2594] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:21 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:21.897943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1840e-47ff-4354-a4e1-83ac11eb6b59 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.908171 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1840e-47ff-4354-a4e1-83ac11eb6b59 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:21.912886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6f17f-11c5-4e46-8590-d51512ff16a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:21.913533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6f17f-11c5-4e46-8590-d51512ff16a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.913846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6f17f-11c5-4e46-8590-d51512ff16a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.914312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6f17f-11c5-4e46-8590-d51512ff16a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.915048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6f17f-11c5-4e46-8590-d51512ff16a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:21.916619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6f17f-11c5-4e46-8590-d51512ff16a5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:21.926900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1295/2595] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:21.930976 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb14b4-353f-4a8b-9d05-fbabf8dd4364 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.941570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb14b4-353f-4a8b-9d05-fbabf8dd4364 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:21.946235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5818e6-ee90-4df2-bda2-a41713a99052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:21.946889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5818e6-ee90-4df2-bda2-a41713a99052 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.947173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5818e6-ee90-4df2-bda2-a41713a99052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.947451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5818e6-ee90-4df2-bda2-a41713a99052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.948168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5818e6-ee90-4df2-bda2-a41713a99052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:21.949733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5818e6-ee90-4df2-bda2-a41713a99052 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:21.963731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1301/2596] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:21.964927 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6f17f-11c5-4e46-8590-d51512ff16a5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:21.975290 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6f17f-11c5-4e46-8590-d51512ff16a5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:21.980388 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6b8b-ae44-49d5-a28c-19607933f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:21.981219 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6b8b-ae44-49d5-a28c-19607933f88c admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:21.981501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6b8b-ae44-49d5-a28c-19607933f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:21.982146 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6b8b-ae44-49d5-a28c-19607933f88c admin admin] PATH_INFO: `/v3/projects/2708d16e23754b7aaecfa944d9c71e1a/users/713f099d736d41ed8c006cff6cf01e17/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:21.999764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6b8b-ae44-49d5-a28c-19607933f88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2708d16e23754b7aaecfa944d9c71e1a, user_id=713f099d736d41ed8c006cff6cf01e17, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.003211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6b8b-ae44-49d5-a28c-19607933f88c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.093762 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1296/2597] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:21 2022] PUT /identity/v3/projects/2708d16e23754b7aaecfa944d9c71e1a/users/713f099d736d41ed8c006cff6cf01e17/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:22.105879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2cc8c-f909-414b-a8dd-da59102f169f None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.106225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2cc8c-f909-414b-a8dd-da59102f169f None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.106531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2cc8c-f909-414b-a8dd-da59102f169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.136807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-76d2cc8c-f909-414b-a8dd-da59102f169f None None] MFA Rules not processed for user `713f099d736d41ed8c006cff6cf01e17`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:22.138197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-76d2cc8c-f909-414b-a8dd-da59102f169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:22.211291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1302/2598] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:22.215601 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6b8b-ae44-49d5-a28c-19607933f88c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.285771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6b8b-ae44-49d5-a28c-19607933f88c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.290584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645e9e0-2e9f-4398-a958-5313d2e7f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.291248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645e9e0-2e9f-4398-a958-5313d2e7f069 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.291533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645e9e0-2e9f-4398-a958-5313d2e7f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.291810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645e9e0-2e9f-4398-a958-5313d2e7f069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.292513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645e9e0-2e9f-4398-a958-5313d2e7f069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.294634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645e9e0-2e9f-4398-a958-5313d2e7f069 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.305903 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.411745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1297/2599] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:22 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:22.415791 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2cc8c-f909-414b-a8dd-da59102f169f None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.427572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2cc8c-f909-414b-a8dd-da59102f169f None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.453085 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:22.486593 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a4978-499d-4a7c-8318-a41104ca6729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.487240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4978-499d-4a7c-8318-a41104ca6729 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.487457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4978-499d-4a7c-8318-a41104ca6729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.487734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4978-499d-4a7c-8318-a41104ca6729 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.488425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a4978-499d-4a7c-8318-a41104ca6729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.490346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a4978-499d-4a7c-8318-a41104ca6729 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.602568 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1303/2600] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:22 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:22.607199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645e9e0-2e9f-4398-a958-5313d2e7f069 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.618725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645e9e0-2e9f-4398-a958-5313d2e7f069 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.623426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e40fc-3551-4015-b10c-b0cab3d93864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.624140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e40fc-3551-4015-b10c-b0cab3d93864 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.624425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e40fc-3551-4015-b10c-b0cab3d93864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.624728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e40fc-3551-4015-b10c-b0cab3d93864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.625539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e40fc-3551-4015-b10c-b0cab3d93864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.627717 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e40fc-3551-4015-b10c-b0cab3d93864 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.639405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1298/2601] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:22.643712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a4978-499d-4a7c-8318-a41104ca6729 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.653569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a4978-499d-4a7c-8318-a41104ca6729 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.659256 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef8299-3a79-4112-91f7-c171061e9aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.660155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8299-3a79-4112-91f7-c171061e9aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.660437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8299-3a79-4112-91f7-c171061e9aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.660716 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef8299-3a79-4112-91f7-c171061e9aaa admin admin] PATH_INFO: `/v3/projects/3c37fbac689f4dac97da2435aa4c2e0e/users/864d52deddfa49d49931376e30d4911d/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.677197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef8299-3a79-4112-91f7-c171061e9aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c37fbac689f4dac97da2435aa4c2e0e, user_id=864d52deddfa49d49931376e30d4911d, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.679858 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef8299-3a79-4112-91f7-c171061e9aaa admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.796992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1304/2602] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:22 2022] PUT /identity/v3/projects/3c37fbac689f4dac97da2435aa4c2e0e/users/864d52deddfa49d49931376e30d4911d/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:22.800882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e40fc-3551-4015-b10c-b0cab3d93864 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.811026 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e40fc-3551-4015-b10c-b0cab3d93864 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.879352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b833a7-ac93-475e-991f-da33576a9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.879352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b833a7-ac93-475e-991f-da33576a9690 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.879352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b833a7-ac93-475e-991f-da33576a9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.880488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b833a7-ac93-475e-991f-da33576a9690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.881225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b833a7-ac93-475e-991f-da33576a9690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.882849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b833a7-ac93-475e-991f-da33576a9690 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.893551 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1299/2603] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:22.897594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef8299-3a79-4112-91f7-c171061e9aaa admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:22.908893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef8299-3a79-4112-91f7-c171061e9aaa admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:22.913551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:22.914466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.914753 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.915030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] PATH_INFO: `/v3/projects/3c37fbac689f4dac97da2435aa4c2e0e/users/864d52deddfa49d49931376e30d4911d/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.916993 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c37fbac689f4dac97da2435aa4c2e0e, user_id=864d52deddfa49d49931376e30d4911d, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:22.919640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:22.933506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1305/2604] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:22 2022] PUT /identity/v3/projects/3c37fbac689f4dac97da2435aa4c2e0e/users/864d52deddfa49d49931376e30d4911d/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:22.940848 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59bd9a-73cb-4bcb-bebb-ebcaea312a92 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:22.953729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59bd9a-73cb-4bcb-bebb-ebcaea312a92 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:22.953729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59bd9a-73cb-4bcb-bebb-ebcaea312a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:22.969598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-cb59bd9a-73cb-4bcb-bebb-ebcaea312a92 None None] MFA Rules not processed for user `864d52deddfa49d49931376e30d4911d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:22.970861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cb59bd9a-73cb-4bcb-bebb-ebcaea312a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:23.040326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1300/2605] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:23.051658 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:23.053262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:23.114316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f046-1387-4595-851b-7e2c2eafdd31 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:23.118206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c34070-0c08-40ef-9606-5f0dc342bf27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:23.118857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c34070-0c08-40ef-9606-5f0dc342bf27 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.119135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c34070-0c08-40ef-9606-5f0dc342bf27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.119406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c34070-0c08-40ef-9606-5f0dc342bf27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.128959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c34070-0c08-40ef-9606-5f0dc342bf27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:23.130404 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c34070-0c08-40ef-9606-5f0dc342bf27 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.140561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1306/2606] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:23.243414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59bd9a-73cb-4bcb-bebb-ebcaea312a92 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:23.244822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-cb59bd9a-73cb-4bcb-bebb-ebcaea312a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:23.259285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59bd9a-73cb-4bcb-bebb-ebcaea312a92 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:23.262979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:23.263657 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.263942 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.264220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.325999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:23.333478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.334525 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:23.346203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1301/2607] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:23.506733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa73dba-b021-4a6b-beb0-cf086f26fded None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.507261 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa73dba-b021-4a6b-beb0-cf086f26fded None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.507347 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa73dba-b021-4a6b-beb0-cf086f26fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.527606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7aa73dba-b021-4a6b-beb0-cf086f26fded None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:23.528876 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7aa73dba-b021-4a6b-beb0-cf086f26fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:23.596582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1307/2608] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:08:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:23.620204 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:23.621114 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:23.692912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996d64-627b-461e-ac7c-cc4979ae9d6b service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:23.698083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94806994-3473-476d-b9b3-cfe505f7fc63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:23.699787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94806994-3473-476d-b9b3-cfe505f7fc63 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:23.699787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94806994-3473-476d-b9b3-cfe505f7fc63 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:23.699787 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94806994-3473-476d-b9b3-cfe505f7fc63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:23.708863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94806994-3473-476d-b9b3-cfe505f7fc63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:23.710554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94806994-3473-476d-b9b3-cfe505f7fc63 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:23.719426 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1302/2609] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:08:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:08:26.504672 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa73dba-b021-4a6b-beb0-cf086f26fded None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:26.551156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:26.605068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa73dba-b021-4a6b-beb0-cf086f26fded None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:26.610151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:26.615939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:26.616221 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:26.616506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] PATH_INFO: `/v3/users/713f099d736d41ed8c006cff6cf01e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:26.625490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=713f099d736d41ed8c006cff6cf01e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:26.627621 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:26.953104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713f099d736d41ed8c006cff6cf01e17'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:26.953910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713f099d736d41ed8c006cff6cf01e17'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:26.954732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713f099d736d41ed8c006cff6cf01e17'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.018582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713f099d736d41ed8c006cff6cf01e17'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.032431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713f099d736d41ed8c006cff6cf01e17'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.050426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1308/2610] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:26 2022] DELETE /identity/v3/users/713f099d736d41ed8c006cff6cf01e17 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:27.057214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e0a2-80a3-40a4-b58a-41d43158ac6e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:27.057726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e0a2-80a3-40a4-b58a-41d43158ac6e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:27.058027 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e0a2-80a3-40a4-b58a-41d43158ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:27.091198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-85d2e0a2-80a3-40a4-b58a-41d43158ac6e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:27.093403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-85d2e0a2-80a3-40a4-b58a-41d43158ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:27.196706 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1303/2611] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:27.207336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:27.208844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:27.286834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef678-0a4d-4f1a-b814-80e51ac4ce9f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:27.290881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2075-d434-4a16-a8bc-c259dc8f3b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:27.291766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2075-d434-4a16-a8bc-c259dc8f3b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:27.292234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2075-d434-4a16-a8bc-c259dc8f3b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:27.292704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2075-d434-4a16-a8bc-c259dc8f3b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:27.304370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae2075-d434-4a16-a8bc-c259dc8f3b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:27.305811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae2075-d434-4a16-a8bc-c259dc8f3b61 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:27.316494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1309/2612] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:27.783957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2e0a2-80a3-40a4-b58a-41d43158ac6e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:27.785678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-85d2e0a2-80a3-40a4-b58a-41d43158ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:27.805496 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2e0a2-80a3-40a4-b58a-41d43158ac6e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:27.816289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:27.817176 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:27.817464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:27.817742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] PATH_INFO: `/v3/projects/2708d16e23754b7aaecfa944d9c71e1a` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:27.824577 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2708d16e23754b7aaecfa944d9c71e1a)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:27.826576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:27.956782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2708d16e23754b7aaecfa944d9c71e1a', 'request_id': 'req-0ce2ecf0-1613-4761-9296-43ada6cd102b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:27.964696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2708d16e23754b7aaecfa944d9c71e1a', 'request_id': 'req-0ce2ecf0-1613-4761-9296-43ada6cd102b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.058900 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2708d16e23754b7aaecfa944d9c71e1a', 'request_id': 'req-0ce2ecf0-1613-4761-9296-43ada6cd102b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.073214 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] The token cache is being invalidate because project 2708d16e23754b7aaecfa944d9c71e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:28.073594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.074373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.076018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1304/2613] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:27 2022] DELETE /identity/v3/projects/2708d16e23754b7aaecfa944d9c71e1a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:28.080835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2075-d434-4a16-a8bc-c259dc8f3b61 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.091219 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2075-d434-4a16-a8bc-c259dc8f3b61 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.145265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:28.160954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.161904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.162224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.162567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] PATH_INFO: `/v3/users/864d52deddfa49d49931376e30d4911d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.163834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=864d52deddfa49d49931376e30d4911d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.165800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:28.352429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864d52deddfa49d49931376e30d4911d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.353488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864d52deddfa49d49931376e30d4911d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.354042 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864d52deddfa49d49931376e30d4911d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.432680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864d52deddfa49d49931376e30d4911d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.447507 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864d52deddfa49d49931376e30d4911d'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.460622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1310/2614] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:28 2022] DELETE /identity/v3/users/864d52deddfa49d49931376e30d4911d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:28.508746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.510789 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:28.528318 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2ecf0-1613-4761-9296-43ada6cd102b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:28.541971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:28.624634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:28.625545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:28.625814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:28.626183 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] PATH_INFO: `/v3/users/a524c7ab9a79482eb9f54772839c1e32` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:28.627425 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a524c7ab9a79482eb9f54772839c1e32)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:28.629434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:28.869833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a524c7ab9a79482eb9f54772839c1e32'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.870549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a524c7ab9a79482eb9f54772839c1e32'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.878764 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a524c7ab9a79482eb9f54772839c1e32'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.879469 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a524c7ab9a79482eb9f54772839c1e32'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.961631 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-140119f4-248e-48af-98e0-a61a7d3ed874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a524c7ab9a79482eb9f54772839c1e32'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:28.973017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:28.975842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:29.003630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91b74f-1110-42eb-8163-c58928ec1e84 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.009524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.010510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.010879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.011161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] PATH_INFO: `/v3/projects/3c37fbac689f4dac97da2435aa4c2e0e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.011840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1305/2615] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:28 2022] DELETE /identity/v3/users/a524c7ab9a79482eb9f54772839c1e32 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:29.013179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c37fbac689f4dac97da2435aa4c2e0e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.016054 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.023899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e592e-47c0-494b-83df-cd344ae7ae2c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.024122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e592e-47c0-494b-83df-cd344ae7ae2c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.024405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e592e-47c0-494b-83df-cd344ae7ae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.053362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2b4e592e-47c0-494b-83df-cd344ae7ae2c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:29.054955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2b4e592e-47c0-494b-83df-cd344ae7ae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:29.120609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1306/2616] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:29.130853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e592e-47c0-494b-83df-cd344ae7ae2c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.132476 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2b4e592e-47c0-494b-83df-cd344ae7ae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:29.166020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c37fbac689f4dac97da2435aa4c2e0e', 'request_id': 'req-511b45ad-0925-4f2a-ab43-a353d5ff539c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:29.174020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c37fbac689f4dac97da2435aa4c2e0e', 'request_id': 'req-511b45ad-0925-4f2a-ab43-a353d5ff539c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:29.179303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:29.198846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c37fbac689f4dac97da2435aa4c2e0e', 'request_id': 'req-511b45ad-0925-4f2a-ab43-a353d5ff539c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:29.205590 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e592e-47c0-494b-83df-cd344ae7ae2c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.260996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a916c8b-cf61-4fe0-b847-40eeae8a65a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.261933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916c8b-cf61-4fe0-b847-40eeae8a65a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.262479 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916c8b-cf61-4fe0-b847-40eeae8a65a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.262940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a916c8b-cf61-4fe0-b847-40eeae8a65a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.282598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] The token cache is being invalidate because project 3c37fbac689f4dac97da2435aa4c2e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:29.282598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:29.282598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511b45ad-0925-4f2a-ab43-a353d5ff539c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:29.283049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1311/2617] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:28 2022] DELETE /identity/v3/projects/3c37fbac689f4dac97da2435aa4c2e0e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:29.287740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565956f8-3ea6-4167-9510-4b5be6ab33a7 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.288061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565956f8-3ea6-4167-9510-4b5be6ab33a7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.288343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565956f8-3ea6-4167-9510-4b5be6ab33a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.310905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-565956f8-3ea6-4167-9510-4b5be6ab33a7 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:29.313608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-565956f8-3ea6-4167-9510-4b5be6ab33a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:29.334389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a916c8b-cf61-4fe0-b847-40eeae8a65a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.335943 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a916c8b-cf61-4fe0-b847-40eeae8a65a0 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.351309 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1307/2618] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:29.387565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:29.423992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1312/2619] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:29.431732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0736b3-3e80-4130-9621-7a1fe0df3778 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.432063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0736b3-3e80-4130-9621-7a1fe0df3778 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.432349 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0736b3-3e80-4130-9621-7a1fe0df3778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.463767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2f0736b3-3e80-4130-9621-7a1fe0df3778 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:29.465220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2f0736b3-3e80-4130-9621-7a1fe0df3778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:29.490152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1308/2620] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:29.494136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565956f8-3ea6-4167-9510-4b5be6ab33a7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.505797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565956f8-3ea6-4167-9510-4b5be6ab33a7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.510955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.511781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.512326 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.512796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.513514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:29.521604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.526095 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.544825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1313/2621] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:29.549239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0736b3-3e80-4130-9621-7a1fe0df3778 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.563779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0736b3-3e80-4130-9621-7a1fe0df3778 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.569818 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33f73f-03cc-43a1-8186-7761d570c663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.570837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f73f-03cc-43a1-8186-7761d570c663 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.571126 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f73f-03cc-43a1-8186-7761d570c663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.571405 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f73f-03cc-43a1-8186-7761d570c663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.572104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33f73f-03cc-43a1-8186-7761d570c663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.574185 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33f73f-03cc-43a1-8186-7761d570c663 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.782356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1309/2622] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/projects => generated 387 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:08:29.788575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:29.803916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae64522-e76b-436c-b44c-d0e80c2d1cab admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:29.875569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:29.875855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:29.875950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:29.876339 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:29.877108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:29.879616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:29.986512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1314/2623] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:29 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:29.990540 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33f73f-03cc-43a1-8186-7761d570c663 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.002073 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33f73f-03cc-43a1-8186-7761d570c663 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.014213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b269e-919f-4fef-9c4c-b848c093e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.014213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b269e-919f-4fef-9c4c-b848c093e03c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.014213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b269e-919f-4fef-9c4c-b848c093e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.014213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b269e-919f-4fef-9c4c-b848c093e03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.014592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b269e-919f-4fef-9c4c-b848c093e03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.014592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b269e-919f-4fef-9c4c-b848c093e03c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.015744 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.017801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.049449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecdb2c-17df-4a0b-9566-74d0c47eedb2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.057605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1310/2624] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:30.058985 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b269e-919f-4fef-9c4c-b848c093e03c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.062789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.063673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.063963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.064241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] PATH_INFO: `/v3/projects/f1c61f56874445e88b3c9b69ec77871f` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.068634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c61f56874445e88b3c9b69ec77871f)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.072173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.080031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b269e-919f-4fef-9c4c-b848c093e03c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.084846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9460e-0636-428c-b088-f95390b2d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.085544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9460e-0636-428c-b088-f95390b2d4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.085810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9460e-0636-428c-b088-f95390b2d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.086117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9460e-0636-428c-b088-f95390b2d4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.087179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9460e-0636-428c-b088-f95390b2d4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.089107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9460e-0636-428c-b088-f95390b2d4c1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.114489 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1311/2625] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:30.118515 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9460e-0636-428c-b088-f95390b2d4c1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.130703 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9460e-0636-428c-b088-f95390b2d4c1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.135839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbec703-71fc-4f51-bcbd-3e9c9fa81410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.136726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbec703-71fc-4f51-bcbd-3e9c9fa81410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.137007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbec703-71fc-4f51-bcbd-3e9c9fa81410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.137283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbec703-71fc-4f51-bcbd-3e9c9fa81410 admin admin] PATH_INFO: `/v3/projects/bdf1c7c7891d44f2a173e0b6cc5a509b/users/3f3741fa593340eb804b6a091bd262ae/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.154841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbec703-71fc-4f51-bcbd-3e9c9fa81410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf1c7c7891d44f2a173e0b6cc5a509b, user_id=3f3741fa593340eb804b6a091bd262ae, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.158003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbec703-71fc-4f51-bcbd-3e9c9fa81410 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.243123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1312/2626] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:30 2022] PUT /identity/v3/projects/bdf1c7c7891d44f2a173e0b6cc5a509b/users/3f3741fa593340eb804b6a091bd262ae/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:30.251362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120159e-99b5-4b4a-9615-5e0ba061662d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.251651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120159e-99b5-4b4a-9615-5e0ba061662d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.251932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120159e-99b5-4b4a-9615-5e0ba061662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.258873 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c61f56874445e88b3c9b69ec77871f', 'request_id': 'req-52a38e42-2f82-4c02-aebc-7481e9e29ee4'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.269317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c61f56874445e88b3c9b69ec77871f', 'request_id': 'req-52a38e42-2f82-4c02-aebc-7481e9e29ee4'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.277847 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c61f56874445e88b3c9b69ec77871f', 'request_id': 'req-52a38e42-2f82-4c02-aebc-7481e9e29ee4'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.299907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d120159e-99b5-4b4a-9615-5e0ba061662d None None] MFA Rules not processed for user `3f3741fa593340eb804b6a091bd262ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:30.301472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d120159e-99b5-4b4a-9615-5e0ba061662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.317814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:30.351601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] The token cache is being invalidate because project f1c61f56874445e88b3c9b69ec77871f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:30.365565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.365565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-52a38e42-2f82-4c02-aebc-7481e9e29ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:30.365565 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1315/2627] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:30 2022] DELETE /identity/v3/projects/f1c61f56874445e88b3c9b69ec77871f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:30.380032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f392a-3fcb-4201-97fe-3af0d3da5e22 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.380767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f392a-3fcb-4201-97fe-3af0d3da5e22 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.381298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f392a-3fcb-4201-97fe-3af0d3da5e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.393011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1313/2628] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:30.394325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120159e-99b5-4b4a-9615-5e0ba061662d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.396518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d120159e-99b5-4b4a-9615-5e0ba061662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.418096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8f7f392a-3fcb-4201-97fe-3af0d3da5e22 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:30.419880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8f7f392a-3fcb-4201-97fe-3af0d3da5e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.486981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:30.506160 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120159e-99b5-4b4a-9615-5e0ba061662d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.511144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979a8f-6a76-4411-92d3-a7e24a5d1794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.511892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979a8f-6a76-4411-92d3-a7e24a5d1794 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.512258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979a8f-6a76-4411-92d3-a7e24a5d1794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.512611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979a8f-6a76-4411-92d3-a7e24a5d1794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.513403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979a8f-6a76-4411-92d3-a7e24a5d1794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.525304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979a8f-6a76-4411-92d3-a7e24a5d1794 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.530570 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1316/2629] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:30.532126 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530688f-2073-4251-bf54-b256198c0406 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.532415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530688f-2073-4251-bf54-b256198c0406 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.532767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530688f-2073-4251-bf54-b256198c0406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.558788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a530688f-2073-4251-bf54-b256198c0406 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:30.560006 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a530688f-2073-4251-bf54-b256198c0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:30.570139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1317/2630] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:30.574285 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530688f-2073-4251-bf54-b256198c0406 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.583613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530688f-2073-4251-bf54-b256198c0406 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.588363 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.589018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.589316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.589592 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.590354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:30.590662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.592317 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.605486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1318/2631] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:08:30.610522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.629731 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67012e19-3e1c-48f1-a16f-7833279cb311 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.634512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc074fb-8d58-490c-bda0-7c338c23cad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.635177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc074fb-8d58-490c-bda0-7c338c23cad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.635467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc074fb-8d58-490c-bda0-7c338c23cad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.635732 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc074fb-8d58-490c-bda0-7c338c23cad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.636427 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc074fb-8d58-490c-bda0-7c338c23cad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:30.639954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc074fb-8d58-490c-bda0-7c338c23cad9 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:30.890306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1319/2632] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:30.890845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1314/2633] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/projects => generated 387 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:30.894646 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc074fb-8d58-490c-bda0-7c338c23cad9 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.897653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979a8f-6a76-4411-92d3-a7e24a5d1794 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:30.989583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc074fb-8d58-490c-bda0-7c338c23cad9 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:30.996472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967c037-d5bd-4030-b86b-3b734f73a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:30.997228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967c037-d5bd-4030-b86b-3b734f73a09d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:30.997586 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967c037-d5bd-4030-b86b-3b734f73a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:30.997932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967c037-d5bd-4030-b86b-3b734f73a09d admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:30.999511 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967c037-d5bd-4030-b86b-3b734f73a09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.001890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967c037-d5bd-4030-b86b-3b734f73a09d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.028586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979a8f-6a76-4411-92d3-a7e24a5d1794 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.034221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8c5cd-6fa0-4bd5-a201-4496f8b3d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.034996 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c5cd-6fa0-4bd5-a201-4496f8b3d626 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.035366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c5cd-6fa0-4bd5-a201-4496f8b3d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.035712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8c5cd-6fa0-4bd5-a201-4496f8b3d626 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.036513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8c5cd-6fa0-4bd5-a201-4496f8b3d626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.038518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8c5cd-6fa0-4bd5-a201-4496f8b3d626 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.082835 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1320/2634] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:31.084750 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967c037-d5bd-4030-b86b-3b734f73a09d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.095279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967c037-d5bd-4030-b86b-3b734f73a09d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.100023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc98a3-9fe6-44a9-bf6d-f3bc356f8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.100703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc98a3-9fe6-44a9-bf6d-f3bc356f8b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.100987 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc98a3-9fe6-44a9-bf6d-f3bc356f8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.101267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc98a3-9fe6-44a9-bf6d-f3bc356f8b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.102018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc98a3-9fe6-44a9-bf6d-f3bc356f8b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.103891 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc98a3-9fe6-44a9-bf6d-f3bc356f8b4d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.117667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1321/2635] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:31.129460 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc98a3-9fe6-44a9-bf6d-f3bc356f8b4d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.139684 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc98a3-9fe6-44a9-bf6d-f3bc356f8b4d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.144364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672f84-8a04-439a-8f41-ac6aef2697a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.145291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672f84-8a04-439a-8f41-ac6aef2697a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.145580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672f84-8a04-439a-8f41-ac6aef2697a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.145846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5672f84-8a04-439a-8f41-ac6aef2697a4 admin admin] PATH_INFO: `/v3/projects/46e5237c80b0413f908318af6a80ed5d/users/1c6ad99117fb433ab821b837097d5170/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.153281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1315/2636] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:30 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:31.160393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8c5cd-6fa0-4bd5-a201-4496f8b3d626 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.164432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672f84-8a04-439a-8f41-ac6aef2697a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e5237c80b0413f908318af6a80ed5d, user_id=1c6ad99117fb433ab821b837097d5170, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.167135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5672f84-8a04-439a-8f41-ac6aef2697a4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.171865 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8c5cd-6fa0-4bd5-a201-4496f8b3d626 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.177074 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57576000-3772-4f0f-949b-0ab6e3595eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.180683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576000-3772-4f0f-949b-0ab6e3595eef admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.180683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576000-3772-4f0f-949b-0ab6e3595eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.180683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576000-3772-4f0f-949b-0ab6e3595eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.180683 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57576000-3772-4f0f-949b-0ab6e3595eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.181088 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57576000-3772-4f0f-949b-0ab6e3595eef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.192164 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1316/2637] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:31.195987 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57576000-3772-4f0f-949b-0ab6e3595eef admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.206853 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57576000-3772-4f0f-949b-0ab6e3595eef admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.211860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078835-db01-4df0-aaea-a44f0beae7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.212535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078835-db01-4df0-aaea-a44f0beae7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.212819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078835-db01-4df0-aaea-a44f0beae7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.213098 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078835-db01-4df0-aaea-a44f0beae7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.213928 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4078835-db01-4df0-aaea-a44f0beae7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.215543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4078835-db01-4df0-aaea-a44f0beae7a1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.228434 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1317/2638] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:31.232346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078835-db01-4df0-aaea-a44f0beae7a1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.243890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078835-db01-4df0-aaea-a44f0beae7a1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.249226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e31ea2-511e-4f08-836e-54e6493898a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.250340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31ea2-511e-4f08-836e-54e6493898a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.250586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31ea2-511e-4f08-836e-54e6493898a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.250866 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e31ea2-511e-4f08-836e-54e6493898a2 admin admin] PATH_INFO: `/v3/projects/d2c631e8f3d544309a09e7bf6e39f780/users/6b9e8a4e5a51463c826c821375c1d28c/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.253296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:31.267042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e31ea2-511e-4f08-836e-54e6493898a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c631e8f3d544309a09e7bf6e39f780, user_id=6b9e8a4e5a51463c826c821375c1d28c, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.272167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e31ea2-511e-4f08-836e-54e6493898a2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.284851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1322/2639] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:31 2022] PUT /identity/v3/projects/46e5237c80b0413f908318af6a80ed5d/users/1c6ad99117fb433ab821b837097d5170/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:31.288806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672f84-8a04-439a-8f41-ac6aef2697a4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.355877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5672f84-8a04-439a-8f41-ac6aef2697a4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.361138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd624612-d2c6-4201-b5c8-36c4856f437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.361902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd624612-d2c6-4201-b5c8-36c4856f437f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.362216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd624612-d2c6-4201-b5c8-36c4856f437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.362499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd624612-d2c6-4201-b5c8-36c4856f437f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.363216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd624612-d2c6-4201-b5c8-36c4856f437f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.364775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd624612-d2c6-4201-b5c8-36c4856f437f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.370106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:31.376781 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1323/2640] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:31.377578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1318/2641] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:31 2022] PUT /identity/v3/projects/d2c631e8f3d544309a09e7bf6e39f780/users/6b9e8a4e5a51463c826c821375c1d28c/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:31.381143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd624612-d2c6-4201-b5c8-36c4856f437f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.382767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc116a-1d94-4600-99a7-deae8a502fed None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.383138 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc116a-1d94-4600-99a7-deae8a502fed None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.383400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc116a-1d94-4600-99a7-deae8a502fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.392681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd624612-d2c6-4201-b5c8-36c4856f437f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.401086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1acc116a-1d94-4600-99a7-deae8a502fed None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:31.402392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1acc116a-1d94-4600-99a7-deae8a502fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:31.452181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8543ce-392b-400e-95ba-c59158dee2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.453063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8543ce-392b-400e-95ba-c59158dee2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.453343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8543ce-392b-400e-95ba-c59158dee2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.453737 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8543ce-392b-400e-95ba-c59158dee2c2 admin admin] PATH_INFO: `/v3/projects/46e5237c80b0413f908318af6a80ed5d/users/1c6ad99117fb433ab821b837097d5170/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.455838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8543ce-392b-400e-95ba-c59158dee2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e5237c80b0413f908318af6a80ed5d, user_id=1c6ad99117fb433ab821b837097d5170, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.458492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8543ce-392b-400e-95ba-c59158dee2c2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.463722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1319/2642] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:31.472809 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1324/2643] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:31 2022] PUT /identity/v3/projects/46e5237c80b0413f908318af6a80ed5d/users/1c6ad99117fb433ab821b837097d5170/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:31.474370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc116a-1d94-4600-99a7-deae8a502fed None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.475803 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1acc116a-1d94-4600-99a7-deae8a502fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:31.484068 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f477f90-b5eb-4a7f-b7a0-5d597c1c05a7 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.484499 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f477f90-b5eb-4a7f-b7a0-5d597c1c05a7 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.484780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f477f90-b5eb-4a7f-b7a0-5d597c1c05a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.511401 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-3f477f90-b5eb-4a7f-b7a0-5d597c1c05a7 None None] MFA Rules not processed for user `1c6ad99117fb433ab821b837097d5170`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:31.512610 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3f477f90-b5eb-4a7f-b7a0-5d597c1c05a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:31.535723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc116a-1d94-4600-99a7-deae8a502fed None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.582441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1325/2644] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:31.587827 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121c6f5-8c7a-42fa-a48f-44441614b683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.592681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c6f5-8c7a-42fa-a48f-44441614b683 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.592681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c6f5-8c7a-42fa-a48f-44441614b683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.592681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c6f5-8c7a-42fa-a48f-44441614b683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.594842 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f477f90-b5eb-4a7f-b7a0-5d597c1c05a7 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:31.596243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3f477f90-b5eb-4a7f-b7a0-5d597c1c05a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:31.646288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:31.657803 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f477f90-b5eb-4a7f-b7a0-5d597c1c05a7 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:31.658823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121c6f5-8c7a-42fa-a48f-44441614b683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.660352 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121c6f5-8c7a-42fa-a48f-44441614b683 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.661723 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b1799-ecb6-4879-be23-40c71cbc0d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:31.662498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b1799-ecb6-4879-be23-40c71cbc0d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:31.662724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b1799-ecb6-4879-be23-40c71cbc0d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:31.663004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b1799-ecb6-4879-be23-40c71cbc0d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:31.670669 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1320/2645] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:31.673746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b1799-ecb6-4879-be23-40c71cbc0d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:31.675444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375b1799-ecb6-4879-be23-40c71cbc0d5d service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:31.685992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1326/2646] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:32.825745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121c6f5-8c7a-42fa-a48f-44441614b683 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:32.836733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121c6f5-8c7a-42fa-a48f-44441614b683 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:32.842393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:32.843545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:32.843545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:32.843545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] PATH_INFO: `/v3/users/3f3741fa593340eb804b6a091bd262ae` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:32.844907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3741fa593340eb804b6a091bd262ae)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:32.846884 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:32.953276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42bce-281f-4297-9d33-ab4b4ac94b49 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:32.954250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42bce-281f-4297-9d33-ab4b4ac94b49 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:32.957860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42bce-281f-4297-9d33-ab4b4ac94b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:32.984779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4fe42bce-281f-4297-9d33-ab4b4ac94b49 None None] MFA Rules not processed for user `6b9e8a4e5a51463c826c821375c1d28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:32.986040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4fe42bce-281f-4297-9d33-ab4b4ac94b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:32.996372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:33.059135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3741fa593340eb804b6a091bd262ae'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:33.059799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3741fa593340eb804b6a091bd262ae'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:33.062273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1327/2647] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:33.072513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3741fa593340eb804b6a091bd262ae'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:33.076716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3741fa593340eb804b6a091bd262ae'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:33.076869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42bce-281f-4297-9d33-ab4b4ac94b49 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:33.084408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42bce-281f-4297-9d33-ab4b4ac94b49 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:33.088118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b3afd-a366-43aa-a531-67619d4c8047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:33.088926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3afd-a366-43aa-a531-67619d4c8047 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:33.089209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3afd-a366-43aa-a531-67619d4c8047 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:33.089484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3afd-a366-43aa-a531-67619d4c8047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:33.091354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-399b3afd-a366-43aa-a531-67619d4c8047 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:33.103397 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b3afd-a366-43aa-a531-67619d4c8047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:33.105160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b3afd-a366-43aa-a531-67619d4c8047 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:33.114989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1328/2648] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:08:33.152518 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3741fa593340eb804b6a091bd262ae'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:33.180548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1321/2649] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:32 2022] DELETE /identity/v3/users/3f3741fa593340eb804b6a091bd262ae => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:33.185200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0c20-3d20-4024-82ce-68b3ae149de1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:33.189340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0c20-3d20-4024-82ce-68b3ae149de1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:33.189340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0c20-3d20-4024-82ce-68b3ae149de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:33.204983 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a66c0c20-3d20-4024-82ce-68b3ae149de1 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:33.206252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a66c0c20-3d20-4024-82ce-68b3ae149de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:33.270717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1329/2650] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:33.280700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:33.283023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:33.340724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548de5fa-4938-4910-91b3-fa6097bcaed0 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:33.345523 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fb394-0b3d-4db5-8c3b-9ef08ea0b712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:33.346245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fb394-0b3d-4db5-8c3b-9ef08ea0b712 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:33.346546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fb394-0b3d-4db5-8c3b-9ef08ea0b712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:33.346825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fb394-0b3d-4db5-8c3b-9ef08ea0b712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:33.356295 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fb394-0b3d-4db5-8c3b-9ef08ea0b712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:33.358167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fb394-0b3d-4db5-8c3b-9ef08ea0b712 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:33.367961 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1322/2651] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:33.835926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c0c20-3d20-4024-82ce-68b3ae149de1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:33.837453 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a66c0c20-3d20-4024-82ce-68b3ae149de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:33.867481 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c0c20-3d20-4024-82ce-68b3ae149de1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:33.872544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:33.873867 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:33.874237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:33.874520 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] PATH_INFO: `/v3/projects/bdf1c7c7891d44f2a173e0b6cc5a509b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:33.875783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf1c7c7891d44f2a173e0b6cc5a509b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:33.877643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:34.003970 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf1c7c7891d44f2a173e0b6cc5a509b', 'request_id': 'req-73ac23b7-8020-486d-8c89-35461d5b5524'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.010359 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf1c7c7891d44f2a173e0b6cc5a509b', 'request_id': 'req-73ac23b7-8020-486d-8c89-35461d5b5524'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.016532 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf1c7c7891d44f2a173e0b6cc5a509b', 'request_id': 'req-73ac23b7-8020-486d-8c89-35461d5b5524'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.115702 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] The token cache is being invalidate because project bdf1c7c7891d44f2a173e0b6cc5a509b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:34.115915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.116530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.118197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1330/2652] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:33 2022] DELETE /identity/v3/projects/bdf1c7c7891d44f2a173e0b6cc5a509b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:34.122169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fb394-0b3d-4db5-8c3b-9ef08ea0b712 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:34.132666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fb394-0b3d-4db5-8c3b-9ef08ea0b712 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:34.190899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:34.191841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:34.192319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:34.192319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] PATH_INFO: `/v3/users/1c6ad99117fb433ab821b837097d5170` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:34.193713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6ad99117fb433ab821b837097d5170)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:34.195537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:34.200368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:34.417289 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6ad99117fb433ab821b837097d5170'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.417940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6ad99117fb433ab821b837097d5170'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.425681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6ad99117fb433ab821b837097d5170'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.426364 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6ad99117fb433ab821b837097d5170'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.493140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-23de92e7-9bb6-4cec-927a-156bc423df0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6ad99117fb433ab821b837097d5170'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:34.512030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1323/2653] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:34 2022] DELETE /identity/v3/users/1c6ad99117fb433ab821b837097d5170 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:34.914854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:34.916505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:34.938403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f788a9-1dd7-420c-be53-7c133e02d84e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:34.940866 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f788a9-1dd7-420c-be53-7c133e02d84e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:34.940866 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f788a9-1dd7-420c-be53-7c133e02d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:34.941348 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac23b7-8020-486d-8c89-35461d5b5524 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:34.959543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-39f788a9-1dd7-420c-be53-7c133e02d84e None None] MFA Rules not processed for user `6b9e8a4e5a51463c826c821375c1d28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:34.960795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-39f788a9-1dd7-420c-be53-7c133e02d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:34.963088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:35.008934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.009840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.010147 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.010428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] PATH_INFO: `/v3/projects/46e5237c80b0413f908318af6a80ed5d` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.011659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e5237c80b0413f908318af6a80ed5d)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.013572 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.020958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1324/2654] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:35.131027 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e5237c80b0413f908318af6a80ed5d', 'request_id': 'req-fb30b79d-0537-4526-bc7c-6b9476c9316e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.140943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e5237c80b0413f908318af6a80ed5d', 'request_id': 'req-fb30b79d-0537-4526-bc7c-6b9476c9316e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.150447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e5237c80b0413f908318af6a80ed5d', 'request_id': 'req-fb30b79d-0537-4526-bc7c-6b9476c9316e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.236730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] The token cache is being invalidate because project 46e5237c80b0413f908318af6a80ed5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:35.241146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.241146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-fb30b79d-0537-4526-bc7c-6b9476c9316e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:35.241146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1331/2655] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:34 2022] DELETE /identity/v3/projects/46e5237c80b0413f908318af6a80ed5d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:35.244772 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc46-bfe5-43ac-8c31-ec962d222e88 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.245303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc46-bfe5-43ac-8c31-ec962d222e88 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.245401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38cc46-bfe5-43ac-8c31-ec962d222e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.265286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7d38cc46-bfe5-43ac-8c31-ec962d222e88 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:35.275348 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7d38cc46-bfe5-43ac-8c31-ec962d222e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:35.333460 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1325/2656] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:35.341253 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da8f0-b27f-4195-a556-d3e1da97a243 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.341544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da8f0-b27f-4195-a556-d3e1da97a243 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.341848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46da8f0-b27f-4195-a556-d3e1da97a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.365428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-a46da8f0-b27f-4195-a556-d3e1da97a243 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:35.366967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a46da8f0-b27f-4195-a556-d3e1da97a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:35.380249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1332/2657] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:35.384215 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38cc46-bfe5-43ac-8c31-ec962d222e88 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.395508 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38cc46-bfe5-43ac-8c31-ec962d222e88 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.421101 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.421793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.422099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.422386 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.423133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:35.423446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.425093 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.445516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1326/2658] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:08:35.450007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46da8f0-b27f-4195-a556-d3e1da97a243 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.460728 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46da8f0-b27f-4195-a556-d3e1da97a243 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.466080 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ed14-d19d-466e-98f0-1f527d2236e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.470379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ed14-d19d-466e-98f0-1f527d2236e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.470379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ed14-d19d-466e-98f0-1f527d2236e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.470379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ed14-d19d-466e-98f0-1f527d2236e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.470379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ed14-d19d-466e-98f0-1f527d2236e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.470379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ed14-d19d-466e-98f0-1f527d2236e2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:35.555806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1333/2659] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:35 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:35.559957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:35.571080 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ced82-6901-4bec-8159-69bfc331935b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:35.585320 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:35.637298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4bff0-8473-4fb2-a076-97a2434c074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:35.637990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4bff0-8473-4fb2-a076-97a2434c074d admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:35.638326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4bff0-8473-4fb2-a076-97a2434c074d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:35.638608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4bff0-8473-4fb2-a076-97a2434c074d admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:35.640773 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4bff0-8473-4fb2-a076-97a2434c074d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:35.641291 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4bff0-8473-4fb2-a076-97a2434c074d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:36.794387 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1327/2660] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:35 2022] POST /identity/v3/users => generated 292 bytes in 1235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:08:36.808011 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ed14-d19d-466e-98f0-1f527d2236e2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:36.811020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ed14-d19d-466e-98f0-1f527d2236e2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:36.816813 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505bff3-baa7-436f-8f08-c6e4377a8c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:36.817868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505bff3-baa7-436f-8f08-c6e4377a8c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:36.818373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505bff3-baa7-436f-8f08-c6e4377a8c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:36.818852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505bff3-baa7-436f-8f08-c6e4377a8c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:36.819727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505bff3-baa7-436f-8f08-c6e4377a8c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:36.821417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505bff3-baa7-436f-8f08-c6e4377a8c52 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:36.837972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1334/2661] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:36.839343 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4bff0-8473-4fb2-a076-97a2434c074d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:36.851779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4bff0-8473-4fb2-a076-97a2434c074d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:36.857393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c86268-39f5-44aa-94c6-bc456b1617ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:36.858090 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c86268-39f5-44aa-94c6-bc456b1617ec admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:36.858402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c86268-39f5-44aa-94c6-bc456b1617ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:36.858737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c86268-39f5-44aa-94c6-bc456b1617ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:36.861252 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c86268-39f5-44aa-94c6-bc456b1617ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:36.862994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c86268-39f5-44aa-94c6-bc456b1617ec admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:36.874299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1328/2662] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:36.881223 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505bff3-baa7-436f-8f08-c6e4377a8c52 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:36.892341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505bff3-baa7-436f-8f08-c6e4377a8c52 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:36.897741 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65988fed-c274-44b0-a76f-2988f273c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:36.898717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65988fed-c274-44b0-a76f-2988f273c51d admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:36.899003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65988fed-c274-44b0-a76f-2988f273c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:36.899284 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65988fed-c274-44b0-a76f-2988f273c51d admin admin] PATH_INFO: `/v3/projects/19f0d622e0694de98294009ca56fce84/users/bbb031bc498443e4a5d44a22414d9905/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:36.916200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65988fed-c274-44b0-a76f-2988f273c51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f0d622e0694de98294009ca56fce84, user_id=bbb031bc498443e4a5d44a22414d9905, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:36.918904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65988fed-c274-44b0-a76f-2988f273c51d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:36.987372 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1335/2663] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:36 2022] PUT /identity/v3/projects/19f0d622e0694de98294009ca56fce84/users/bbb031bc498443e4a5d44a22414d9905/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:37.000377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2b66-5791-4527-b858-65d5d3ef7e68 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:37.000671 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2b66-5791-4527-b858-65d5d3ef7e68 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:37.000949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f2b66-5791-4527-b858-65d5d3ef7e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:37.028619 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-215f2b66-5791-4527-b858-65d5d3ef7e68 None None] MFA Rules not processed for user `bbb031bc498443e4a5d44a22414d9905`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:37.029886 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-215f2b66-5791-4527-b858-65d5d3ef7e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:37.098286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1329/2664] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:37.103186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65988fed-c274-44b0-a76f-2988f273c51d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:37.154884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:37.169104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65988fed-c274-44b0-a76f-2988f273c51d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:37.174498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ae7d-53a1-4834-aa76-f3088949e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:37.175170 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ae7d-53a1-4834-aa76-f3088949e834 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:37.175455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ae7d-53a1-4834-aa76-f3088949e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:37.175733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259ae7d-53a1-4834-aa76-f3088949e834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:37.176464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ae7d-53a1-4834-aa76-f3088949e834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:37.178426 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259ae7d-53a1-4834-aa76-f3088949e834 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:37.312005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1336/2665] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:37 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:37.316143 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2b66-5791-4527-b858-65d5d3ef7e68 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:37.326938 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f2b66-5791-4527-b858-65d5d3ef7e68 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:37.411798 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f1b1-0b14-4072-97a2-63101ecfa343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:37.412475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f1b1-0b14-4072-97a2-63101ecfa343 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:37.412760 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f1b1-0b14-4072-97a2-63101ecfa343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:37.413033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4f1b1-0b14-4072-97a2-63101ecfa343 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:37.413735 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4f1b1-0b14-4072-97a2-63101ecfa343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:37.415720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4f1b1-0b14-4072-97a2-63101ecfa343 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:37.522656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1330/2666] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:37 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:08:37.526654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ae7d-53a1-4834-aa76-f3088949e834 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:37.536882 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259ae7d-53a1-4834-aa76-f3088949e834 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:37.543117 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaf09b-e275-46ff-bf77-21cc878245a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:37.543852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaf09b-e275-46ff-bf77-21cc878245a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:37.544149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaf09b-e275-46ff-bf77-21cc878245a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:37.544428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aaf09b-e275-46ff-bf77-21cc878245a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:37.545263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaf09b-e275-46ff-bf77-21cc878245a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:37.546931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aaf09b-e275-46ff-bf77-21cc878245a7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:37.572136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1337/2667] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:37.573978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f1b1-0b14-4072-97a2-63101ecfa343 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:37.586028 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4f1b1-0b14-4072-97a2-63101ecfa343 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:37.591061 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949cff6-c858-43e4-99d7-0d60382eca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:37.591752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cff6-c858-43e4-99d7-0d60382eca70 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:37.592034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cff6-c858-43e4-99d7-0d60382eca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:37.592308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949cff6-c858-43e4-99d7-0d60382eca70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:37.593033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949cff6-c858-43e4-99d7-0d60382eca70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:37.595433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949cff6-c858-43e4-99d7-0d60382eca70 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:37.607627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1331/2668] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:37.612101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaf09b-e275-46ff-bf77-21cc878245a7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:37.622275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aaf09b-e275-46ff-bf77-21cc878245a7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:37.627494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1261390-8513-43ce-b123-0218d0e38aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:37.628402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261390-8513-43ce-b123-0218d0e38aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:37.628680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261390-8513-43ce-b123-0218d0e38aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:37.628951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261390-8513-43ce-b123-0218d0e38aa4 admin admin] PATH_INFO: `/v3/projects/f49261df0296477ca840d14b66b64e5f/users/d44a69adc7304006bd4097a4cdbf2987/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:37.644619 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1261390-8513-43ce-b123-0218d0e38aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49261df0296477ca840d14b66b64e5f, user_id=d44a69adc7304006bd4097a4cdbf2987, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:37.647430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1261390-8513-43ce-b123-0218d0e38aa4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:37.773994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1338/2669] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:37 2022] PUT /identity/v3/projects/f49261df0296477ca840d14b66b64e5f/users/d44a69adc7304006bd4097a4cdbf2987/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:37.784533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81331-cb9d-495b-90f5-3420b89c28ce None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:37.784822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81331-cb9d-495b-90f5-3420b89c28ce None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:37.785103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb81331-cb9d-495b-90f5-3420b89c28ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:37.790935 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:37.813539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bbb81331-cb9d-495b-90f5-3420b89c28ce None None] MFA Rules not processed for user `d44a69adc7304006bd4097a4cdbf2987`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:37.814797 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bbb81331-cb9d-495b-90f5-3420b89c28ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:37.891605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1332/2670] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:37.897843 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1261390-8513-43ce-b123-0218d0e38aa4 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:37.966000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1261390-8513-43ce-b123-0218d0e38aa4 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:37.972674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83dfa2-dbf9-441d-94b1-6e318a3d81b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:37.973071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83dfa2-dbf9-441d-94b1-6e318a3d81b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:37.973433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83dfa2-dbf9-441d-94b1-6e318a3d81b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:37.973717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83dfa2-dbf9-441d-94b1-6e318a3d81b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:37.974501 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83dfa2-dbf9-441d-94b1-6e318a3d81b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:37.976395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83dfa2-dbf9-441d-94b1-6e318a3d81b3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:38.099206 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1339/2671] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:37 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:38.101905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb81331-cb9d-495b-90f5-3420b89c28ce None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:38.113513 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb81331-cb9d-495b-90f5-3420b89c28ce None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:38.177213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f9c5-3e92-49ca-828b-3753c0eea66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:38.177899 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f9c5-3e92-49ca-828b-3753c0eea66b admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:38.178217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f9c5-3e92-49ca-828b-3753c0eea66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:38.178499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56f9c5-3e92-49ca-828b-3753c0eea66b admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:38.179196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56f9c5-3e92-49ca-828b-3753c0eea66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:38.181129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56f9c5-3e92-49ca-828b-3753c0eea66b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:38.264887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1333/2672] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:38 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:38.269072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83dfa2-dbf9-441d-94b1-6e318a3d81b3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:38.279698 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83dfa2-dbf9-441d-94b1-6e318a3d81b3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:38.285292 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b7a18-0e06-427f-9b12-9267898e5a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:38.285952 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7a18-0e06-427f-9b12-9267898e5a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:38.286270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7a18-0e06-427f-9b12-9267898e5a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:38.286546 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7a18-0e06-427f-9b12-9267898e5a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:38.287268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b7a18-0e06-427f-9b12-9267898e5a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:38.288865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b7a18-0e06-427f-9b12-9267898e5a14 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:38.300880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1340/2673] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:38.305173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f9c5-3e92-49ca-828b-3753c0eea66b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:38.315323 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56f9c5-3e92-49ca-828b-3753c0eea66b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:38.319925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3e2d-f351-49f1-9110-3db616a1ac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:38.320814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3e2d-f351-49f1-9110-3db616a1ac2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:38.321086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3e2d-f351-49f1-9110-3db616a1ac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:38.321826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb3e2d-f351-49f1-9110-3db616a1ac2e admin admin] PATH_INFO: `/v3/projects/57a625c9a3c240a2a7abbdacb79a87c1/users/8bc0f82227e940e88b482412f8b436f5/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:38.336725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb3e2d-f351-49f1-9110-3db616a1ac2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a625c9a3c240a2a7abbdacb79a87c1, user_id=8bc0f82227e940e88b482412f8b436f5, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:38.339406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb3e2d-f351-49f1-9110-3db616a1ac2e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:38.395793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1334/2674] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:38 2022] PUT /identity/v3/projects/57a625c9a3c240a2a7abbdacb79a87c1/users/8bc0f82227e940e88b482412f8b436f5/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:38.399804 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b7a18-0e06-427f-9b12-9267898e5a14 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:38.410854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b7a18-0e06-427f-9b12-9267898e5a14 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:38.476840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3c73d-0057-43ac-b321-2ba1e9899bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:38.477519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c73d-0057-43ac-b321-2ba1e9899bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:38.478052 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c73d-0057-43ac-b321-2ba1e9899bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:38.478374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c73d-0057-43ac-b321-2ba1e9899bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:38.479214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3c73d-0057-43ac-b321-2ba1e9899bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:38.480980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3c73d-0057-43ac-b321-2ba1e9899bb6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:38.496030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1341/2675] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:08:38.497713 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3e2d-f351-49f1-9110-3db616a1ac2e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:38.509552 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb3e2d-f351-49f1-9110-3db616a1ac2e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:38.514308 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:38.515337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:38.516108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:38.516108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] PATH_INFO: `/v3/projects/57a625c9a3c240a2a7abbdacb79a87c1/users/8bc0f82227e940e88b482412f8b436f5/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:38.517990 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a625c9a3c240a2a7abbdacb79a87c1, user_id=8bc0f82227e940e88b482412f8b436f5, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:38.520678 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:38.533546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1335/2676] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:38 2022] PUT /identity/v3/projects/57a625c9a3c240a2a7abbdacb79a87c1/users/8bc0f82227e940e88b482412f8b436f5/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:38.544928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040985d2-2386-4937-b77f-85e394c549ab None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:38.545263 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040985d2-2386-4937-b77f-85e394c549ab None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:38.545503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040985d2-2386-4937-b77f-85e394c549ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:38.565498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:38.575025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-040985d2-2386-4937-b77f-85e394c549ab None None] MFA Rules not processed for user `8bc0f82227e940e88b482412f8b436f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:38.576276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-040985d2-2386-4937-b77f-85e394c549ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:38.653268 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1342/2677] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:38.665324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:38.670091 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:38.722042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:38.734427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fea3a2-1c54-4e7a-9b68-3c428097a577 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:38.738413 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:38.739069 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:38.739355 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:38.739634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:38.799998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:38.801807 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:38.811253 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1336/2678] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:39.039811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dae4-5f7c-443c-b7d0-0537325d8497 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:39.040687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dae4-5f7c-443c-b7d0-0537325d8497 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:39.041133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6dae4-5f7c-443c-b7d0-0537325d8497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:39.063943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f4e6dae4-5f7c-443c-b7d0-0537325d8497 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:39.065167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f4e6dae4-5f7c-443c-b7d0-0537325d8497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:39.130629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1343/2679] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 22 09:08:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:39.144708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:39.146293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:39.222257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5dd30-7643-4de4-87bf-c1352210a9a3 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:39.232245 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd45453-564c-4f64-b136-c85725d698c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:39.233205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd45453-564c-4f64-b136-c85725d698c1 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:39.233722 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd45453-564c-4f64-b136-c85725d698c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:39.233882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd45453-564c-4f64-b136-c85725d698c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:39.243666 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd45453-564c-4f64-b136-c85725d698c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:39.245169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd45453-564c-4f64-b136-c85725d698c1 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:39.253225 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1337/2680] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:08:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:08:40.740745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6dae4-5f7c-443c-b7d0-0537325d8497 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:40.742242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f4e6dae4-5f7c-443c-b7d0-0537325d8497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:40.754767 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6dae4-5f7c-443c-b7d0-0537325d8497 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:40.758629 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bb585-0ac7-4044-a3a9-370bfead4667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:40.759281 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bb585-0ac7-4044-a3a9-370bfead4667 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:40.759636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bb585-0ac7-4044-a3a9-370bfead4667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:40.759918 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bb585-0ac7-4044-a3a9-370bfead4667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:40.818388 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bb585-0ac7-4044-a3a9-370bfead4667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:40.819817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bb585-0ac7-4044-a3a9-370bfead4667 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:40.829146 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1344/2681] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:42.328019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd45453-564c-4f64-b136-c85725d698c1 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:42.338124 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd45453-564c-4f64-b136-c85725d698c1 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:42.341849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc397c6d-2d97-4713-8870-f488e6f676e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:42.342531 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc397c6d-2d97-4713-8870-f488e6f676e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:42.342863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc397c6d-2d97-4713-8870-f488e6f676e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:42.343153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc397c6d-2d97-4713-8870-f488e6f676e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:42.353404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc397c6d-2d97-4713-8870-f488e6f676e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:42.354881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc397c6d-2d97-4713-8870-f488e6f676e5 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:42.365393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1338/2682] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:46.969463 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bb585-0ac7-4044-a3a9-370bfead4667 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.011074 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=100 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:47.031979 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bb585-0ac7-4044-a3a9-370bfead4667 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.037321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.038251 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.038534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.038807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] PATH_INFO: `/v3/users/bbb031bc498443e4a5d44a22414d9905` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.040001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb031bc498443e4a5d44a22414d9905)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.042007 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.279274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb031bc498443e4a5d44a22414d9905'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.279932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb031bc498443e4a5d44a22414d9905'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.280529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb031bc498443e4a5d44a22414d9905'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.352125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb031bc498443e4a5d44a22414d9905'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.367341 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb031bc498443e4a5d44a22414d9905'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:47.380609 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1345/2683] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:46 2022] DELETE /identity/v3/users/bbb031bc498443e4a5d44a22414d9905 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:47.384804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c87c6-9fa8-4653-bd11-51485c7d4c9a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.385238 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c87c6-9fa8-4653-bd11-51485c7d4c9a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.385351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c87c6-9fa8-4653-bd11-51485c7d4c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.404173 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ac5c87c6-9fa8-4653-bd11-51485c7d4c9a None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:47.405385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ac5c87c6-9fa8-4653-bd11-51485c7d4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:47.472148 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1339/2684] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:47.482752 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:47.484241 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:47.555288 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399b9d9-e6f9-4c3a-8816-754c923d5d71 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:47.558971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaafaba-b856-4e22-9f8c-8c7db031fcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:47.559642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafaba-b856-4e22-9f8c-8c7db031fcbf service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:47.559910 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafaba-b856-4e22-9f8c-8c7db031fcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:47.560192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaafaba-b856-4e22-9f8c-8c7db031fcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:47.570472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaafaba-b856-4e22-9f8c-8c7db031fcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:47.571906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaafaba-b856-4e22-9f8c-8c7db031fcbf service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:47.582741 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1346/2685] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:48.045564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c87c6-9fa8-4653-bd11-51485c7d4c9a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.047035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ac5c87c6-9fa8-4653-bd11-51485c7d4c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:48.059037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c87c6-9fa8-4653-bd11-51485c7d4c9a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.064586 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.065605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.065991 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.066317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] PATH_INFO: `/v3/projects/19f0d622e0694de98294009ca56fce84` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.067583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f0d622e0694de98294009ca56fce84)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.069582 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.082400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:48.166356 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f0d622e0694de98294009ca56fce84', 'request_id': 'req-89ae6e75-d48f-4b45-ad0c-80bf7965996a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.171724 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f0d622e0694de98294009ca56fce84', 'request_id': 'req-89ae6e75-d48f-4b45-ad0c-80bf7965996a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.232210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f0d622e0694de98294009ca56fce84', 'request_id': 'req-89ae6e75-d48f-4b45-ad0c-80bf7965996a'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.244147 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] The token cache is being invalidate because project 19f0d622e0694de98294009ca56fce84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:48.244433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.245079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.246674 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1340/2686] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:48 2022] DELETE /identity/v3/projects/19f0d622e0694de98294009ca56fce84 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:48.251163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaafaba-b856-4e22-9f8c-8c7db031fcbf service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:48.260875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaafaba-b856-4e22-9f8c-8c7db031fcbf service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:48.318107 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:48.318923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:48.319208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:48.319486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] PATH_INFO: `/v3/users/d44a69adc7304006bd4097a4cdbf2987` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:48.320676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44a69adc7304006bd4097a4cdbf2987)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:48.322651 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:48.326395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:48.531476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44a69adc7304006bd4097a4cdbf2987'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.532163 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44a69adc7304006bd4097a4cdbf2987'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.532915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44a69adc7304006bd4097a4cdbf2987'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.615682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44a69adc7304006bd4097a4cdbf2987'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.631513 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44a69adc7304006bd4097a4cdbf2987'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:48.643925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1347/2687] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:48 2022] DELETE /identity/v3/users/d44a69adc7304006bd4097a4cdbf2987 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:49.151684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:49.153070 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:49.167139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae6e75-d48f-4b45-ad0c-80bf7965996a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:49.230021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:49.230952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:49.231261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:49.231543 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] PATH_INFO: `/v3/projects/f49261df0296477ca840d14b66b64e5f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:49.232730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49261df0296477ca840d14b66b64e5f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:49.234710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:49.335516 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49261df0296477ca840d14b66b64e5f', 'request_id': 'req-90b01c28-ed78-4b44-9f8c-c4d568b86675'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.340965 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49261df0296477ca840d14b66b64e5f', 'request_id': 'req-90b01c28-ed78-4b44-9f8c-c4d568b86675'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.391832 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49261df0296477ca840d14b66b64e5f', 'request_id': 'req-90b01c28-ed78-4b44-9f8c-c4d568b86675'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.408874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] The token cache is being invalidate because project f49261df0296477ca840d14b66b64e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:49.408874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.408874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.408874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1341/2688] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:49 2022] DELETE /identity/v3/projects/f49261df0296477ca840d14b66b64e5f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:49.411660 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:49.413096 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:49.427082 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f643fd-1c16-496b-b0cd-aea306df8035 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:49.485742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:49.486772 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:49.487045 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:49.487329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] PATH_INFO: `/v3/users/8bc0f82227e940e88b482412f8b436f5` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:49.488529 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc0f82227e940e88b482412f8b436f5)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:49.490455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:49.640618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc0f82227e940e88b482412f8b436f5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.641272 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc0f82227e940e88b482412f8b436f5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.641909 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc0f82227e940e88b482412f8b436f5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.717760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc0f82227e940e88b482412f8b436f5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.732402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-8c9a00f4-2ebb-4c49-8ecf-4ff774fc1297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc0f82227e940e88b482412f8b436f5'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:49.740613 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:49.746486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1348/2689] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:08:49 2022] DELETE /identity/v3/users/8bc0f82227e940e88b482412f8b436f5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:08:50.203218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:50.204769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:50.220079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01c28-ed78-4b44-9f8c-c4d568b86675 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:50.251397 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:50.285169 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:50.286360 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:50.286636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:50.286914 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] PATH_INFO: `/v3/projects/57a625c9a3c240a2a7abbdacb79a87c1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:50.288178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a625c9a3c240a2a7abbdacb79a87c1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:50.290213 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:50.407701 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a625c9a3c240a2a7abbdacb79a87c1', 'request_id': 'req-27d13718-bc20-4050-9a41-73c6cda60c6b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:50.414193 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a625c9a3c240a2a7abbdacb79a87c1', 'request_id': 'req-27d13718-bc20-4050-9a41-73c6cda60c6b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:50.494770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a625c9a3c240a2a7abbdacb79a87c1', 'request_id': 'req-27d13718-bc20-4050-9a41-73c6cda60c6b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:50.507303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] The token cache is being invalidate because project 57a625c9a3c240a2a7abbdacb79a87c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:08:50.507623 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:50.508278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-27d13718-bc20-4050-9a41-73c6cda60c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:08:50.509828 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1342/2690] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:08:50 2022] DELETE /identity/v3/projects/57a625c9a3c240a2a7abbdacb79a87c1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:50.515649 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1c6c-409a-4784-a020-c6fce6c07456 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:50.516113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1c6c-409a-4784-a020-c6fce6c07456 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:50.516383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb1c6c-409a-4784-a020-c6fce6c07456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:50.536525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4efb1c6c-409a-4784-a020-c6fce6c07456 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:50.537831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4efb1c6c-409a-4784-a020-c6fce6c07456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:50.599718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1349/2691] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:50.614770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c788e-bbda-4f31-8937-5c0bc43d0132 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:50.614770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c788e-bbda-4f31-8937-5c0bc43d0132 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:50.614770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c788e-bbda-4f31-8937-5c0bc43d0132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:50.627152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-995c788e-bbda-4f31-8937-5c0bc43d0132 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:50.628960 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-995c788e-bbda-4f31-8937-5c0bc43d0132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:50.636999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1343/2692] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:08:50.641330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1c6c-409a-4784-a020-c6fce6c07456 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:50.651950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb1c6c-409a-4784-a020-c6fce6c07456 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:50.656655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:50.657313 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:50.657599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:50.657877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:50.658735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:08:50.659089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:50.662200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:50.674919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1350/2693] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:08:50.679034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c788e-bbda-4f31-8937-5c0bc43d0132 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:50.689720 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c788e-bbda-4f31-8937-5c0bc43d0132 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:50.695337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca9e0d-bf98-4d1f-a45f-ce96cc0e0e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:50.696018 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca9e0d-bf98-4d1f-a45f-ce96cc0e0e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:50.696298 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca9e0d-bf98-4d1f-a45f-ce96cc0e0e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:50.696576 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca9e0d-bf98-4d1f-a45f-ce96cc0e0e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:50.697268 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca9e0d-bf98-4d1f-a45f-ce96cc0e0e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:50.699269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca9e0d-bf98-4d1f-a45f-ce96cc0e0e9b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:50.782448 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1344/2694] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:08:50 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:50.789488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:50.800875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660e6c2-fda9-4835-91d4-729543448c02 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:50.860399 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3e9-ca8e-411d-b187-b8463173ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:50.861075 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3e9-ca8e-411d-b187-b8463173ea9d admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:50.861358 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3e9-ca8e-411d-b187-b8463173ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:50.861636 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab3e9-ca8e-411d-b187-b8463173ea9d admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:50.863264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab3e9-ca8e-411d-b187-b8463173ea9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:50.865195 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab3e9-ca8e-411d-b187-b8463173ea9d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:50.969779 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1351/2695] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:08:50 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:08:50.974505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca9e0d-bf98-4d1f-a45f-ce96cc0e0e9b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:50.985422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca9e0d-bf98-4d1f-a45f-ce96cc0e0e9b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:50.990273 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67ebe-5686-44b4-9ec2-feecf4b0343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:50.991172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67ebe-5686-44b4-9ec2-feecf4b0343f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:50.991527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67ebe-5686-44b4-9ec2-feecf4b0343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:50.991808 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac67ebe-5686-44b4-9ec2-feecf4b0343f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:50.992541 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac67ebe-5686-44b4-9ec2-feecf4b0343f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:50.994175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac67ebe-5686-44b4-9ec2-feecf4b0343f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:51.004791 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1345/2696] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:51.008703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3e9-ca8e-411d-b187-b8463173ea9d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:51.019352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab3e9-ca8e-411d-b187-b8463173ea9d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:51.024012 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236969d-1887-43bb-bea3-98ac5c7f2b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:51.024714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236969d-1887-43bb-bea3-98ac5c7f2b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:51.024999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236969d-1887-43bb-bea3-98ac5c7f2b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:51.025301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236969d-1887-43bb-bea3-98ac5c7f2b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:51.026025 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236969d-1887-43bb-bea3-98ac5c7f2b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:51.027626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236969d-1887-43bb-bea3-98ac5c7f2b0b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:51.038392 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1352/2697] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:08:51.046216 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67ebe-5686-44b4-9ec2-feecf4b0343f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:51.057140 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac67ebe-5686-44b4-9ec2-feecf4b0343f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:51.061537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:51.062450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:51.062737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:51.063017 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] PATH_INFO: `/v3/projects/19f6894eab29429a9c6829381a675e5f/users/2726a3c19e70480fb92a1fbc6a483806/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:51.078801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f6894eab29429a9c6829381a675e5f, user_id=2726a3c19e70480fb92a1fbc6a483806, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:51.081765 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:51.165404 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1346/2698] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:08:51 2022] PUT /identity/v3/projects/19f6894eab29429a9c6829381a675e5f/users/2726a3c19e70480fb92a1fbc6a483806/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:08:51.176238 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b50aa-e74e-405d-904c-f4a013860226 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:51.176406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b50aa-e74e-405d-904c-f4a013860226 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:51.176688 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b50aa-e74e-405d-904c-f4a013860226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:51.207145 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-2b7b50aa-e74e-405d-904c-f4a013860226 None None] MFA Rules not processed for user `2726a3c19e70480fb92a1fbc6a483806`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:51.208856 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2b7b50aa-e74e-405d-904c-f4a013860226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:51.274559 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:51.285782 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1353/2699] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:51.296918 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:51.298620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:51.364793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f9878-69eb-43e7-86c3-f4096c035cdf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:51.368427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:51.369077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:51.369367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:51.369649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:51.378557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:51.379998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:51.383527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:08:51.389293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1347/2700] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:08:53.302884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1e99-d0c0-4b0e-bddf-da2a38e4ba0d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:53.303464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1e99-d0c0-4b0e-bddf-da2a38e4ba0d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:53.303464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1e99-d0c0-4b0e-bddf-da2a38e4ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:53.321848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-218d1e99-d0c0-4b0e-bddf-da2a38e4ba0d None None] MFA Rules not processed for user `2726a3c19e70480fb92a1fbc6a483806`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:08:53.323089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-218d1e99-d0c0-4b0e-bddf-da2a38e4ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:53.329954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1354/2701] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:08:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:08:55.278846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:08:55.280422 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:55.350825 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31847768-fede-49e7-9e00-c716d4dc5a1e service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:08:55.356203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:08:55.356850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:08:55.357137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:08:55.357414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:08:55.359220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:08:55.372605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:08:55.374537 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:08:55.388613 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1348/2702] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:08:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:03.316437 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:05.383664 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=33 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:11.065930 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e351-4704-4262-b073-45737c194538 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:11.066477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e351-4704-4262-b073-45737c194538 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:11.066573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e351-4704-4262-b073-45737c194538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:11.084685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-1ad8e351-4704-4262-b073-45737c194538 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:11.085919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-1ad8e351-4704-4262-b073-45737c194538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:11.141674 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1355/2703] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:09:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:11.153959 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:11.155465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:11.226333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e910b3e-4cf1-4a28-9d6e-3535c44f1ac1 service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:11.231749 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad00dbd-aab9-4658-8ce0-752eadc353a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:11.232392 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad00dbd-aab9-4658-8ce0-752eadc353a9 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:11.232674 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad00dbd-aab9-4658-8ce0-752eadc353a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:11.232947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad00dbd-aab9-4658-8ce0-752eadc353a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:11.241441 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad00dbd-aab9-4658-8ce0-752eadc353a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:11.243079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad00dbd-aab9-4658-8ce0-752eadc353a9 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:11.251369 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1349/2704] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:09:12.178085 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1d23b-10d8-47cd-a248-558ff22009d6 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:12.178552 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1d23b-10d8-47cd-a248-558ff22009d6 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:12.178788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1d23b-10d8-47cd-a248-558ff22009d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:12.196690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-e1b1d23b-10d8-47cd-a248-558ff22009d6 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:12.197897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e1b1d23b-10d8-47cd-a248-558ff22009d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:12.205655 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1356/2705] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 22 09:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:12.218172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad00dbd-aab9-4658-8ce0-752eadc353a9 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:12.231055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad00dbd-aab9-4658-8ce0-752eadc353a9 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:12.236184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31e15b-d715-4f71-9072-485b1baff150 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:12.240823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e15b-d715-4f71-9072-485b1baff150 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:12.240823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e15b-d715-4f71-9072-485b1baff150 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:12.240823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31e15b-d715-4f71-9072-485b1baff150 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:12.246000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31e15b-d715-4f71-9072-485b1baff150 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:12.247820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31e15b-d715-4f71-9072-485b1baff150 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:12.256761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1350/2706] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:09:12.849234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62910695-fa27-4a84-bcb1-9588158ef389 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:12.849524 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62910695-fa27-4a84-bcb1-9588158ef389 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:12.849805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62910695-fa27-4a84-bcb1-9588158ef389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:12.868594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-62910695-fa27-4a84-bcb1-9588158ef389 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:12.870908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-62910695-fa27-4a84-bcb1-9588158ef389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:12.877811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1357/2707] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 22 09:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:12.889702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31e15b-d715-4f71-9072-485b1baff150 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:12.900714 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31e15b-d715-4f71-9072-485b1baff150 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:12.905691 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faad28-aed1-4934-92a3-d338be450f19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:12.906348 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faad28-aed1-4934-92a3-d338be450f19 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:12.906663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faad28-aed1-4934-92a3-d338be450f19 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:12.906946 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faad28-aed1-4934-92a3-d338be450f19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:12.915688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39faad28-aed1-4934-92a3-d338be450f19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:12.917256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39faad28-aed1-4934-92a3-d338be450f19 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:12.926008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1351/2708] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:09:13.480246 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836753a7-6c44-45ad-a05b-1324b7736418 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:13.480714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836753a7-6c44-45ad-a05b-1324b7736418 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:13.480819 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836753a7-6c44-45ad-a05b-1324b7736418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:13.498174 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-836753a7-6c44-45ad-a05b-1324b7736418 None None] MFA Rules not processed for user `6a6d40d5beb849a0aa34a56efbe4b525`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:13.499349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-836753a7-6c44-45ad-a05b-1324b7736418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:13.506588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1358/2709] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 22 09:09:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:13.518949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faad28-aed1-4934-92a3-d338be450f19 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:13.529292 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faad28-aed1-4934-92a3-d338be450f19 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:13.535368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d6643-0a0d-460c-b288-5a20bbd85a05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05a163118f6f44fdbad0c7c889970a7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:13.535999 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6643-0a0d-460c-b288-5a20bbd85a05 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:13.536279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6643-0a0d-460c-b288-5a20bbd85a05 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:13.536555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d6643-0a0d-460c-b288-5a20bbd85a05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:13.545402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d6643-0a0d-460c-b288-5a20bbd85a05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:13.546992 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d6643-0a0d-460c-b288-5a20bbd85a05 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:13.556129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1352/2710] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 22 09:09:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:09:16.187314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836753a7-6c44-45ad-a05b-1324b7736418 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:16.249138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836753a7-6c44-45ad-a05b-1324b7736418 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:16.253631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:16.254517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:16.254794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:16.255064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] PATH_INFO: `/v3/users/2726a3c19e70480fb92a1fbc6a483806` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:16.256234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2726a3c19e70480fb92a1fbc6a483806)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:16.258143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:16.491067 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2726a3c19e70480fb92a1fbc6a483806'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:16.491857 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2726a3c19e70480fb92a1fbc6a483806'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:16.492504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2726a3c19e70480fb92a1fbc6a483806'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:16.557258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2726a3c19e70480fb92a1fbc6a483806'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:16.570175 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2726a3c19e70480fb92a1fbc6a483806'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:16.583298 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1359/2711] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:09:16 2022] DELETE /identity/v3/users/2726a3c19e70480fb92a1fbc6a483806 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:16.588008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61237-9a29-40d7-9893-b4586e0a2a5b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:16.588465 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61237-9a29-40d7-9893-b4586e0a2a5b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:16.591003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a61237-9a29-40d7-9893-b4586e0a2a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:16.607869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-33a61237-9a29-40d7-9893-b4586e0a2a5b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:16.609059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-33a61237-9a29-40d7-9893-b4586e0a2a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:16.672209 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1353/2712] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:16.679693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:16.681861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:16.688620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:16.741454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0667c56-e4da-4d00-8892-021a429cfe00 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:16.745010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:16.745654 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:16.745934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:16.746247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:16.756544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:16.758662 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:16.769820 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1360/2713] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:17.039092 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a61237-9a29-40d7-9893-b4586e0a2a5b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:17.041231 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-33a61237-9a29-40d7-9893-b4586e0a2a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:17.054741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a61237-9a29-40d7-9893-b4586e0a2a5b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:17.060771 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:17.061679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:17.061971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:17.062337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] PATH_INFO: `/v3/projects/19f6894eab29429a9c6829381a675e5f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:17.063665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f6894eab29429a9c6829381a675e5f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:17.073418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:17.171859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:17.175863 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f6894eab29429a9c6829381a675e5f', 'request_id': 'req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:17.181487 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f6894eab29429a9c6829381a675e5f', 'request_id': 'req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:17.252685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f6894eab29429a9c6829381a675e5f', 'request_id': 'req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:17.264736 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] The token cache is being invalidate because project 19f6894eab29429a9c6829381a675e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:09:17.265153 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:17.265840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:17.268372 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1354/2714] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:09:17 2022] DELETE /identity/v3/projects/19f6894eab29429a9c6829381a675e5f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:26.814311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=24 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:27.266708 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:28.052920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:28.054356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:28.066548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660cfee-8ea5-48fb-9bb5-c9a00308c58a service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:28.116574 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:28.117133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:28.117413 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:28.117693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:28.119503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:28.180608 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:28.182019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:28.191841 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1361/2715] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:31.906716 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:31.908845 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:31.927319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b043cef-2bae-45ff-81e0-ea5d315c4c4d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:31.932042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:31.932950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:31.933232 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:31.933511 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] PATH_INFO: `/v3/users/dd07859f7aba4b908b2779af70a5f5e1` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:31.934726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd07859f7aba4b908b2779af70a5f5e1)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:31.936638 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:32.095876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd07859f7aba4b908b2779af70a5f5e1'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.096557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd07859f7aba4b908b2779af70a5f5e1'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.103862 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd07859f7aba4b908b2779af70a5f5e1'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.104505 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd07859f7aba4b908b2779af70a5f5e1'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.208890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-688a88e9-3613-48d6-b354-a638646047d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd07859f7aba4b908b2779af70a5f5e1'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.228326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1355/2716] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:09:31 2022] DELETE /identity/v3/users/dd07859f7aba4b908b2779af70a5f5e1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:32.479932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:32.491855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013f031-2f9b-43b5-831d-f220808bd887 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:32.565916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:32.567149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:32.567409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:32.567685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] PATH_INFO: `/v3/projects/ec813daa61ab4ac59a2197042fb35325` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:32.568897 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec813daa61ab4ac59a2197042fb35325)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:32.570828 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:32.707931 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec813daa61ab4ac59a2197042fb35325', 'request_id': 'req-15940f32-8f2b-436f-a989-4e07f2d088de'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.709810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:32.714617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec813daa61ab4ac59a2197042fb35325', 'request_id': 'req-15940f32-8f2b-436f-a989-4e07f2d088de'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.720306 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec813daa61ab4ac59a2197042fb35325', 'request_id': 'req-15940f32-8f2b-436f-a989-4e07f2d088de'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.797303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] The token cache is being invalidate because project ec813daa61ab4ac59a2197042fb35325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:09:32.797591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.798357 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-15940f32-8f2b-436f-a989-4e07f2d088de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:09:32.799939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1362/2717] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:09:32 2022] DELETE /identity/v3/projects/ec813daa61ab4ac59a2197042fb35325 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:32.805135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788d6e-7624-4bfd-a269-7aaaab34b5e6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:32.805430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788d6e-7624-4bfd-a269-7aaaab34b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:32.805717 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09788d6e-7624-4bfd-a269-7aaaab34b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:32.825254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-09788d6e-7624-4bfd-a269-7aaaab34b5e6 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:32.826534 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-09788d6e-7624-4bfd-a269-7aaaab34b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:32.892488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1356/2718] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:32.900544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02aa0-702d-496c-adfe-bab4410f6fbc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:32.900833 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02aa0-702d-496c-adfe-bab4410f6fbc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:32.901144 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c02aa0-702d-496c-adfe-bab4410f6fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:32.920167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-09c02aa0-702d-496c-adfe-bab4410f6fbc None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:32.921421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-09c02aa0-702d-496c-adfe-bab4410f6fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:32.930494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1363/2719] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:32.934841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09788d6e-7624-4bfd-a269-7aaaab34b5e6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:32.945256 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09788d6e-7624-4bfd-a269-7aaaab34b5e6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:32.951561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:32.951561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:32.951561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:32.951561 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:32.952072 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:09:32.952383 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:32.954023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:32.965910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1357/2720] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:09:32.970516 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c02aa0-702d-496c-adfe-bab4410f6fbc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:32.980461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c02aa0-702d-496c-adfe-bab4410f6fbc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:32.985368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0629f8-4b1f-413b-81ad-10e0aba50ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:32.986047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0629f8-4b1f-413b-81ad-10e0aba50ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:32.986354 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0629f8-4b1f-413b-81ad-10e0aba50ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:32.986755 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0629f8-4b1f-413b-81ad-10e0aba50ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:32.987989 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0629f8-4b1f-413b-81ad-10e0aba50ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:32.989900 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0629f8-4b1f-413b-81ad-10e0aba50ad7 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:33.078699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1364/2721] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:09:32 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:09:33.083247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:33.093401 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9d91c-c43e-43d6-8147-54428262a5ee admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:33.152536 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55645f-3525-4a63-9ac7-127de544084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:33.153131 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55645f-3525-4a63-9ac7-127de544084f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:33.153414 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55645f-3525-4a63-9ac7-127de544084f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:33.153688 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55645f-3525-4a63-9ac7-127de544084f admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:33.154420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55645f-3525-4a63-9ac7-127de544084f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:33.156328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55645f-3525-4a63-9ac7-127de544084f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:33.163141 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:33.254656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1358/2722] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:09:33 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:09:33.259048 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0629f8-4b1f-413b-81ad-10e0aba50ad7 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:33.269564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0629f8-4b1f-413b-81ad-10e0aba50ad7 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:33.274214 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7305dac-138c-4532-a15a-1ef086b8afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:33.274877 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305dac-138c-4532-a15a-1ef086b8afc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:33.275939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305dac-138c-4532-a15a-1ef086b8afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:33.275939 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305dac-138c-4532-a15a-1ef086b8afc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:33.276120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7305dac-138c-4532-a15a-1ef086b8afc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:33.277692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7305dac-138c-4532-a15a-1ef086b8afc1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:33.289118 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1365/2723] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:09:33.293611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55645f-3525-4a63-9ac7-127de544084f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:33.304389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55645f-3525-4a63-9ac7-127de544084f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:33.309032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d30d8-e9dc-48a1-94cc-85f4b1decb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:33.309710 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d30d8-e9dc-48a1-94cc-85f4b1decb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:33.310048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d30d8-e9dc-48a1-94cc-85f4b1decb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:33.310354 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d30d8-e9dc-48a1-94cc-85f4b1decb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:33.311109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d30d8-e9dc-48a1-94cc-85f4b1decb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:33.312702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d30d8-e9dc-48a1-94cc-85f4b1decb83 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:33.323319 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1359/2724] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:09:33.327489 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7305dac-138c-4532-a15a-1ef086b8afc1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:33.337838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7305dac-138c-4532-a15a-1ef086b8afc1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:33.342519 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:33.343395 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:33.343680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:33.343961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] PATH_INFO: `/v3/projects/39db61e788d04620a94bb0ddea0cd726/users/322de5283c4e40ebb3911456f96812cb/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:33.359821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39db61e788d04620a94bb0ddea0cd726, user_id=322de5283c4e40ebb3911456f96812cb, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:33.363278 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:33.444940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1366/2725] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:09:33 2022] PUT /identity/v3/projects/39db61e788d04620a94bb0ddea0cd726/users/322de5283c4e40ebb3911456f96812cb/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:09:33.450094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f733-5c07-4009-a20a-25eacb5312f2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:33.450385 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f733-5c07-4009-a20a-25eacb5312f2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:33.450679 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f733-5c07-4009-a20a-25eacb5312f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:33.468732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a7a6f733-5c07-4009-a20a-25eacb5312f2 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:33.471293 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a7a6f733-5c07-4009-a20a-25eacb5312f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:33.530548 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1360/2726] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:33.540795 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:33.542622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:33.609356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62be04c-68e6-49d9-bcab-65249c8e1950 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:33.614308 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:33.614963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:33.615839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:33.615839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:33.625079 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:33.626545 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:33.636582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1367/2727] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:09:39.187702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1b68-8acf-4ba9-ad39-0bb6422a7255 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:39.188277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1b68-8acf-4ba9-ad39-0bb6422a7255 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:39.188277 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd1b68-8acf-4ba9-ad39-0bb6422a7255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:39.219602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-35cd1b68-8acf-4ba9-ad39-0bb6422a7255 None None] MFA Rules not processed for user `322de5283c4e40ebb3911456f96812cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:39.220813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-35cd1b68-8acf-4ba9-ad39-0bb6422a7255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:39.307616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1361/2728] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:09:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:39.325041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:09:39.326550 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:39.408647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3328c-85b2-4e58-8ea7-05c8013ea8c3 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:09:39.414591 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab243-12ef-46da-8e09-3a605fc25e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:09:39.415255 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab243-12ef-46da-8e09-3a605fc25e02 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:39.415543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab243-12ef-46da-8e09-3a605fc25e02 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:39.415826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab243-12ef-46da-8e09-3a605fc25e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:39.424818 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab243-12ef-46da-8e09-3a605fc25e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:09:39.426464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab243-12ef-46da-8e09-3a605fc25e02 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:09:39.436530 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1368/2729] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:09:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:09:42.555239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4367a-8b31-4d69-abb6-7e416008cce8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:42.555852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4367a-8b31-4d69-abb6-7e416008cce8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:42.555852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4367a-8b31-4d69-abb6-7e416008cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:42.587274 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-51b4367a-8b31-4d69-abb6-7e416008cce8 None None] MFA Rules not processed for user `322de5283c4e40ebb3911456f96812cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:42.589161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-51b4367a-8b31-4d69-abb6-7e416008cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:42.604418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1362/2730] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:09:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:49.432050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:09:50.479812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d877bdf-eac5-48bc-8353-759ddd26230d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:09:50.480440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d877bdf-eac5-48bc-8353-759ddd26230d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:09:50.480440 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d877bdf-eac5-48bc-8353-759ddd26230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:09:50.502250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-9d877bdf-eac5-48bc-8353-759ddd26230d None None] MFA Rules not processed for user `6b9e8a4e5a51463c826c821375c1d28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:09:50.502250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9d877bdf-eac5-48bc-8353-759ddd26230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:09:50.559573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1369/2731] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:09:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:09:52.577408 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:00.552457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=25 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:39.261578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4367a-8b31-4d69-abb6-7e416008cce8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:39.263563 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-51b4367a-8b31-4d69-abb6-7e416008cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:39.327324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4367a-8b31-4d69-abb6-7e416008cce8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:39.330947 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:39.331595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:39.331880 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:39.332156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:39.333941 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:39.348159 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:39.349603 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:39.361328 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1363/2732] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:10:49.356166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=26 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:49.544488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d877bdf-eac5-48bc-8353-759ddd26230d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:49.555868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d877bdf-eac5-48bc-8353-759ddd26230d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:49.559476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:49.560788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:49.560788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:49.560788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:49.562533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:49.578151 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:49.581770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:49.591831 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1370/2733] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:10:58.015041 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:58.016653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:58.035581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bdeb4-9eb5-41e6-930d-56fa80cdaf8b service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:58.041184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:58.042109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:58.042449 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:58.042733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] PATH_INFO: `/v3/users/6b9e8a4e5a51463c826c821375c1d28c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:58.044550 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9e8a4e5a51463c826c821375c1d28c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:58.046616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:58.296152 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9e8a4e5a51463c826c821375c1d28c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.296890 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9e8a4e5a51463c826c821375c1d28c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.304163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9e8a4e5a51463c826c821375c1d28c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.304817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9e8a4e5a51463c826c821375c1d28c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.373339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-95651f8c-cf14-4c70-92ae-166ec7b77b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9e8a4e5a51463c826c821375c1d28c'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.392650 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1364/2734] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:10:58 2022] DELETE /identity/v3/users/6b9e8a4e5a51463c826c821375c1d28c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:10:58.672187 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:58.683712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a4ff0-e3ff-416f-a8e9-83e5eb3f395a service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:58.749196 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:58.750920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:58.750920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:58.750920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] PATH_INFO: `/v3/projects/d2c631e8f3d544309a09e7bf6e39f780` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:58.751906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c631e8f3d544309a09e7bf6e39f780)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:58.753797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:58.900477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c631e8f3d544309a09e7bf6e39f780', 'request_id': 'req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.907044 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c631e8f3d544309a09e7bf6e39f780', 'request_id': 'req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.914166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c631e8f3d544309a09e7bf6e39f780', 'request_id': 'req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.996330 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] The token cache is being invalidate because project d2c631e8f3d544309a09e7bf6e39f780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:10:58.996618 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.997310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-35472d8e-aeac-47eb-9cdf-d1327ee0e17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:10:58.998927 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1371/2735] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:10:58 2022] DELETE /identity/v3/projects/d2c631e8f3d544309a09e7bf6e39f780 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:10:59.004103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acea5-0595-4206-9b8d-002ae381e7e8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.005892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acea5-0595-4206-9b8d-002ae381e7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.005892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acea5-0595-4206-9b8d-002ae381e7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.026389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8b9acea5-0595-4206-9b8d-002ae381e7e8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:59.027604 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8b9acea5-0595-4206-9b8d-002ae381e7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:59.089033 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1365/2736] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:59.149384 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33948aa2-373c-4c1f-875a-9e0b9da8eff0 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.149673 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33948aa2-373c-4c1f-875a-9e0b9da8eff0 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.149949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33948aa2-373c-4c1f-875a-9e0b9da8eff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.170346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-33948aa2-373c-4c1f-875a-9e0b9da8eff0 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:59.171468 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-33948aa2-373c-4c1f-875a-9e0b9da8eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:59.179647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1372/2737] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:59.183919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9acea5-0595-4206-9b8d-002ae381e7e8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:59.194816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9acea5-0595-4206-9b8d-002ae381e7e8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:59.199681 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:59.200484 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.200769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.201044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.201781 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:10:59.202123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:59.203812 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:59.217218 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1366/2738] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:10:59.221603 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33948aa2-373c-4c1f-875a-9e0b9da8eff0 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:59.231915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33948aa2-373c-4c1f-875a-9e0b9da8eff0 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:59.236533 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867bba7-9856-4e62-932e-55a640f592d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:59.237186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867bba7-9856-4e62-932e-55a640f592d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.237464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867bba7-9856-4e62-932e-55a640f592d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.237740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867bba7-9856-4e62-932e-55a640f592d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.238457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867bba7-9856-4e62-932e-55a640f592d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:59.240368 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867bba7-9856-4e62-932e-55a640f592d6 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:59.338267 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1373/2739] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:10:59 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:10:59.339585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:59.351419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5767d-7cfb-4c63-866b-3c963edcadcf admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:59.410133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881904d0-422d-4888-9a18-1d3563fbad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:59.411397 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881904d0-422d-4888-9a18-1d3563fbad18 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.411859 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881904d0-422d-4888-9a18-1d3563fbad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.412351 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881904d0-422d-4888-9a18-1d3563fbad18 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.413054 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881904d0-422d-4888-9a18-1d3563fbad18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:59.415047 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881904d0-422d-4888-9a18-1d3563fbad18 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:59.421852 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:59.516177 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1367/2740] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:10:59 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:10:59.521225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867bba7-9856-4e62-932e-55a640f592d6 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:59.532003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867bba7-9856-4e62-932e-55a640f592d6 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:59.536685 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395745b-7339-4d81-b845-fae70f0ea3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:59.537534 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395745b-7339-4d81-b845-fae70f0ea3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.537817 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395745b-7339-4d81-b845-fae70f0ea3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.538125 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395745b-7339-4d81-b845-fae70f0ea3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.538925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395745b-7339-4d81-b845-fae70f0ea3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:59.540582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395745b-7339-4d81-b845-fae70f0ea3ae admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:59.551265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1374/2741] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:10:59.555419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881904d0-422d-4888-9a18-1d3563fbad18 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:59.565849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881904d0-422d-4888-9a18-1d3563fbad18 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:59.571312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b11b7-70eb-4038-8003-6d9b7a7fa1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:59.571998 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b11b7-70eb-4038-8003-6d9b7a7fa1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.572288 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b11b7-70eb-4038-8003-6d9b7a7fa1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.572564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b11b7-70eb-4038-8003-6d9b7a7fa1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.573365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b11b7-70eb-4038-8003-6d9b7a7fa1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:59.574984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b11b7-70eb-4038-8003-6d9b7a7fa1b8 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:59.586346 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1368/2742] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:10:59.590846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395745b-7339-4d81-b845-fae70f0ea3ae admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:59.601951 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395745b-7339-4d81-b845-fae70f0ea3ae admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:59.607043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:59.607946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.608258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.608567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] PATH_INFO: `/v3/projects/0c6571a499a0498abe9211d2d252bacf/users/23089387f4fd454c9a785ff4d51f48c5/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.624287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6571a499a0498abe9211d2d252bacf, user_id=23089387f4fd454c9a785ff4d51f48c5, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:59.626954 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:59.710588 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1375/2743] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:10:59 2022] PUT /identity/v3/projects/0c6571a499a0498abe9211d2d252bacf/users/23089387f4fd454c9a785ff4d51f48c5/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:10:59.715680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4915c39-e049-4fbd-b6c3-1401b2291a30 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.715977 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4915c39-e049-4fbd-b6c3-1401b2291a30 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.716261 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4915c39-e049-4fbd-b6c3-1401b2291a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.734804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f4915c39-e049-4fbd-b6c3-1401b2291a30 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:10:59.740882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f4915c39-e049-4fbd-b6c3-1401b2291a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:59.797144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1369/2744] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:10:59.807328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:10:59.809324 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:10:59.824814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:10:59.868765 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83791751-471b-4765-886c-a675525bf9cf admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:10:59.872447 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389d6be-6b60-4a66-a20d-b937df9b61eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:10:59.873088 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389d6be-6b60-4a66-a20d-b937df9b61eb service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:10:59.873369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389d6be-6b60-4a66-a20d-b937df9b61eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:10:59.873639 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389d6be-6b60-4a66-a20d-b937df9b61eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:10:59.883745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389d6be-6b60-4a66-a20d-b937df9b61eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:10:59.885155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389d6be-6b60-4a66-a20d-b937df9b61eb service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:10:59.894929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1376/2745] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:05.849445 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd116c-e30e-45c0-bda4-47ab282048f4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:05.849940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd116c-e30e-45c0-bda4-47ab282048f4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:05.850248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd116c-e30e-45c0-bda4-47ab282048f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:05.895353 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-58bd116c-e30e-45c0-bda4-47ab282048f4 None None] MFA Rules not processed for user `23089387f4fd454c9a785ff4d51f48c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:05.896851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-58bd116c-e30e-45c0-bda4-47ab282048f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:05.974025 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1370/2746] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:11:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:05.978895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389d6be-6b60-4a66-a20d-b937df9b61eb service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:05.988558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389d6be-6b60-4a66-a20d-b937df9b61eb service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:05.994400 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958bda5-7320-4886-924f-a0d3dc5f177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:05.995183 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958bda5-7320-4886-924f-a0d3dc5f177e admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:05.995469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958bda5-7320-4886-924f-a0d3dc5f177e admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:05.995747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958bda5-7320-4886-924f-a0d3dc5f177e admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:05.996476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958bda5-7320-4886-924f-a0d3dc5f177e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:05.998419 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958bda5-7320-4886-924f-a0d3dc5f177e admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:06.119201 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1377/2747] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:11:05 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:11:06.124467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd116c-e30e-45c0-bda4-47ab282048f4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:06.136400 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd116c-e30e-45c0-bda4-47ab282048f4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:06.194729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c2286-bd4b-480b-bbda-5040f5e3cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:06.195581 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c2286-bd4b-480b-bbda-5040f5e3cbde admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:06.195831 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c2286-bd4b-480b-bbda-5040f5e3cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:06.196135 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c2286-bd4b-480b-bbda-5040f5e3cbde admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:06.196938 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c2286-bd4b-480b-bbda-5040f5e3cbde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:06.198885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c2286-bd4b-480b-bbda-5040f5e3cbde admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:06.270608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:06.278151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1371/2748] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:11:06 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:11:06.282270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958bda5-7320-4886-924f-a0d3dc5f177e admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:06.294135 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958bda5-7320-4886-924f-a0d3dc5f177e admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:06.299217 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074ae9-5c21-4344-a8c2-15dd87577cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:06.300106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074ae9-5c21-4344-a8c2-15dd87577cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:06.300349 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074ae9-5c21-4344-a8c2-15dd87577cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:06.300700 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21074ae9-5c21-4344-a8c2-15dd87577cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:06.301449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21074ae9-5c21-4344-a8c2-15dd87577cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:06.303844 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21074ae9-5c21-4344-a8c2-15dd87577cb5 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:06.323018 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1378/2749] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:11:06.324226 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c2286-bd4b-480b-bbda-5040f5e3cbde admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:06.335889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c2286-bd4b-480b-bbda-5040f5e3cbde admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:06.341296 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4785-5cf5-4c2c-ba9a-f9071af8b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:06.342262 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4785-5cf5-4c2c-ba9a-f9071af8b897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:06.342578 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4785-5cf5-4c2c-ba9a-f9071af8b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:06.347380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb4785-5cf5-4c2c-ba9a-f9071af8b897 admin admin] PATH_INFO: `/v3/projects/d745a1fcbc8149df916dc64d9a223687/users/1b515d15274c49f48a94e65ddb1e96ca/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:06.361912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb4785-5cf5-4c2c-ba9a-f9071af8b897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d745a1fcbc8149df916dc64d9a223687, user_id=1b515d15274c49f48a94e65ddb1e96ca, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:06.364612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb4785-5cf5-4c2c-ba9a-f9071af8b897 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:06.437363 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1372/2750] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:11:06 2022] PUT /identity/v3/projects/d745a1fcbc8149df916dc64d9a223687/users/1b515d15274c49f48a94e65ddb1e96ca/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:11:06.441701 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074ae9-5c21-4344-a8c2-15dd87577cb5 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:06.453301 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21074ae9-5c21-4344-a8c2-15dd87577cb5 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:06.520104 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303b93f-584c-4767-aae5-8e8612741e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:06.520997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b93f-584c-4767-aae5-8e8612741e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:06.521393 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b93f-584c-4767-aae5-8e8612741e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:06.522657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303b93f-584c-4767-aae5-8e8612741e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:06.523626 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303b93f-584c-4767-aae5-8e8612741e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:06.525425 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303b93f-584c-4767-aae5-8e8612741e2f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:06.535961 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1379/2751] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:11:06.541514 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4785-5cf5-4c2c-ba9a-f9071af8b897 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:06.552475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb4785-5cf5-4c2c-ba9a-f9071af8b897 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:06.557389 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:06.558223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:06.558595 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:06.558770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] PATH_INFO: `/v3/projects/d745a1fcbc8149df916dc64d9a223687/users/1b515d15274c49f48a94e65ddb1e96ca/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:06.561902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d745a1fcbc8149df916dc64d9a223687, user_id=1b515d15274c49f48a94e65ddb1e96ca, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:06.564693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:06.578737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1373/2752] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:11:06 2022] PUT /identity/v3/projects/d745a1fcbc8149df916dc64d9a223687/users/1b515d15274c49f48a94e65ddb1e96ca/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:11:12.999686 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732844c-d861-4842-b081-4c498944d3d9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:13.000327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732844c-d861-4842-b081-4c498944d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:13.001017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732844c-d861-4842-b081-4c498944d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:13.039004 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7732844c-d861-4842-b081-4c498944d3d9 None None] MFA Rules not processed for user `1b515d15274c49f48a94e65ddb1e96ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:13.040630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7732844c-d861-4842-b081-4c498944d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:13.137936 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1380/2753] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:11:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:13.145802 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:13.148199 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:13.236769 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e928026-f8af-4c4c-90f2-4d78e95f5f55 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:13.243919 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:13.244690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:13.245029 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:13.245382 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:13.307032 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:13.310594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:13.320082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1374/2754] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:23.127888 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:23.314626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:31.998825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fb1fe-915f-4f2a-a12b-f8aa1a8ffb81 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:31.999547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fb1fe-915f-4f2a-a12b-f8aa1a8ffb81 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:31.999547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fb1fe-915f-4f2a-a12b-f8aa1a8ffb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:32.018309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-427fb1fe-915f-4f2a-a12b-f8aa1a8ffb81 None None] MFA Rules not processed for user `23089387f4fd454c9a785ff4d51f48c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:11:32.019560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-427fb1fe-915f-4f2a-a12b-f8aa1a8ffb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:32.027334 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1381/2755] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:11:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:11:32.346963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:32.348560 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:32.406068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665820-4b63-4dfa-a240-92e0d199ea80 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:32.409799 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:32.410474 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:32.410761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:32.411042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:32.412843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:32.422520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:32.423936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:32.432083 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1375/2756] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:33.222943 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fb1fe-915f-4f2a-a12b-f8aa1a8ffb81 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:33.224485 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-427fb1fe-915f-4f2a-a12b-f8aa1a8ffb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:33.305526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fb1fe-915f-4f2a-a12b-f8aa1a8ffb81 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:33.311451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:33.312161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:33.312449 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:33.312734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:33.314704 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:33.328061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:33.329645 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:33.339802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1382/2757] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:36.347755 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:36.373046 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722d676-f2c4-4ff8-b8d5-c13419d5ffec service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:36.377745 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:36.378694 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:36.378837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:36.379133 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:36.381621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:36.392200 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:36.393629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:36.402333 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1376/2758] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:37.299023 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:37.321594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b35f6-2297-41a7-aa79-07ade8e308d9 service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:37.330092 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:37.331120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:37.331522 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:37.331894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:37.335811 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:37.351242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:37.351242 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:37.368236 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1383/2759] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:11:46.398203 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=32 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:47.359108 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=41 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:11:48.472012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:48.486217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7a6bd-f3a5-490d-a970-fe611c8b6736 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:48.493451 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b377ed-58a9-4382-a14c-8d566e623caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:48.494106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b377ed-58a9-4382-a14c-8d566e623caa service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:48.494419 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b377ed-58a9-4382-a14c-8d566e623caa service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:48.494654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b377ed-58a9-4382-a14c-8d566e623caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:48.496674 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-48b377ed-58a9-4382-a14c-8d566e623caa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:11:48.509741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b377ed-58a9-4382-a14c-8d566e623caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:48.511339 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b377ed-58a9-4382-a14c-8d566e623caa service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:48.522416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1377/2760] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:51.016309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:11:51.025623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee416158-d5f8-4795-a1da-cd3433487571 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:11:51.029262 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fa466-c309-470c-a2e8-a85061edd625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:11:51.029899 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa466-c309-470c-a2e8-a85061edd625 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:11:51.030225 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa466-c309-470c-a2e8-a85061edd625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:11:51.030555 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa466-c309-470c-a2e8-a85061edd625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:11:51.039914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fa466-c309-470c-a2e8-a85061edd625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:11:51.041329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fa466-c309-470c-a2e8-a85061edd625 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:11:51.051058 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1384/2761] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:11:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:11:58.517677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:01.046664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:40.537877 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11993f-afd5-4e2f-8007-51d656603a8c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:40.538454 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11993f-afd5-4e2f-8007-51d656603a8c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:40.538635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11993f-afd5-4e2f-8007-51d656603a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:40.556970 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1a11993f-afd5-4e2f-8007-51d656603a8c None None] MFA Rules not processed for user `322de5283c4e40ebb3911456f96812cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:12:40.558770 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1a11993f-afd5-4e2f-8007-51d656603a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:40.614402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1378/2762] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:12:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:12:40.926583 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fa466-c309-470c-a2e8-a85061edd625 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:12:40.936923 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fa466-c309-470c-a2e8-a85061edd625 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:12:40.940617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:12:40.941247 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:12:40.941527 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:12:40.941800 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:12:40.943718 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:12:40.954141 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:12:40.955562 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:12:40.963807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1385/2763] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:12:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:12:50.607668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=25 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:12:50.960000 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:55.557902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a583e6-e9ad-4604-ae05-a8c76f26f676 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:55.558446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a583e6-e9ad-4604-ae05-a8c76f26f676 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:55.558553 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a583e6-e9ad-4604-ae05-a8c76f26f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:55.585700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-67a583e6-e9ad-4604-ae05-a8c76f26f676 None None] MFA Rules not processed for user `23089387f4fd454c9a785ff4d51f48c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:13:55.586936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-67a583e6-e9ad-4604-ae05-a8c76f26f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:55.611269 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1379/2764] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:13:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:13:57.934810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:57.934810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:58.033569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e049-19ae-4117-a906-8290eb0c1c82 service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:58.040941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:58.041855 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:58.047846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:58.047846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:58.047846 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:58.064314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:58.065919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:58.078265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1386/2765] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:59.401592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a583e6-e9ad-4604-ae05-a8c76f26f676 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:59.415156 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a583e6-e9ad-4604-ae05-a8c76f26f676 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:59.421527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:59.422535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:59.422841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:59.423109 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:59.425016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:59.437954 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:59.439585 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:59.450376 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1380/2766] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:13:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:13:59.538714 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:13:59.541040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:13:59.653390 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8014aa-c333-4bf0-ac21-07846f0deee7 service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:13:59.659128 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:13:59.660101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:13:59.662569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:13:59.662569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] PATH_INFO: `/v3/users/322de5283c4e40ebb3911456f96812cb` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:13:59.662569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=322de5283c4e40ebb3911456f96812cb)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:13:59.663895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:13:59.828472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322de5283c4e40ebb3911456f96812cb'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:59.829091 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322de5283c4e40ebb3911456f96812cb'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:59.829721 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322de5283c4e40ebb3911456f96812cb'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:59.954209 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322de5283c4e40ebb3911456f96812cb'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:59.967625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:13:59.973036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-56bf93d1-e682-4b11-9eaf-f847b263e683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322de5283c4e40ebb3911456f96812cb'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:13:59.985941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1387/2767] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:13:59 2022] DELETE /identity/v3/users/322de5283c4e40ebb3911456f96812cb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:00.408719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:00.420994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a72e7-08d3-45fb-ad9d-7507d71b7e36 service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:00.494175 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:00.495311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:00.495702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:00.496048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] PATH_INFO: `/v3/projects/39db61e788d04620a94bb0ddea0cd726` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:00.497379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39db61e788d04620a94bb0ddea0cd726)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:00.499728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:00.598821 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39db61e788d04620a94bb0ddea0cd726', 'request_id': 'req-2ae60590-69f0-405d-b348-297d01727db6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:00.604242 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39db61e788d04620a94bb0ddea0cd726', 'request_id': 'req-2ae60590-69f0-405d-b348-297d01727db6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:00.665978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39db61e788d04620a94bb0ddea0cd726', 'request_id': 'req-2ae60590-69f0-405d-b348-297d01727db6'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:00.680337 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] The token cache is being invalidate because project 39db61e788d04620a94bb0ddea0cd726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:14:00.681506 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:00.682241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2ae60590-69f0-405d-b348-297d01727db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:00.684775 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1381/2768] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:00 2022] DELETE /identity/v3/projects/39db61e788d04620a94bb0ddea0cd726 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:14:00.689925 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513039e0-28a1-474f-a45c-4a47c1c01137 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:00.690914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513039e0-28a1-474f-a45c-4a47c1c01137 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:00.691445 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513039e0-28a1-474f-a45c-4a47c1c01137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:00.760505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-513039e0-28a1-474f-a45c-4a47c1c01137 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:00.762218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-513039e0-28a1-474f-a45c-4a47c1c01137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:00.851885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1388/2769] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:00.860403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6656-faa8-4b7d-b6ba-02082855ff71 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:00.861229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6656-faa8-4b7d-b6ba-02082855ff71 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:00.861687 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6656-faa8-4b7d-b6ba-02082855ff71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:00.882407 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-527a6656-faa8-4b7d-b6ba-02082855ff71 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:00.883937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-527a6656-faa8-4b7d-b6ba-02082855ff71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:00.897997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1382/2770] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:14:00.900747 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513039e0-28a1-474f-a45c-4a47c1c01137 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:00.912314 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513039e0-28a1-474f-a45c-4a47c1c01137 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:00.917226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:00.918166 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:00.918455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:00.918736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:00.919486 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:14:00.919797 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:00.921420 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:00.939309 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1389/2771] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:14:00.940674 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6656-faa8-4b7d-b6ba-02082855ff71 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:00.951162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6656-faa8-4b7d-b6ba-02082855ff71 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:00.957287 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403ae0d-192b-4053-ab85-c5f78cd26c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:00.958037 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403ae0d-192b-4053-ab85-c5f78cd26c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:00.958442 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403ae0d-192b-4053-ab85-c5f78cd26c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:00.958850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403ae0d-192b-4053-ab85-c5f78cd26c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:00.959626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403ae0d-192b-4053-ab85-c5f78cd26c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:00.961610 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403ae0d-192b-4053-ab85-c5f78cd26c0e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:01.082325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1383/2772] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:14:00 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:01.083379 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:01.095250 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd72a63-cdcf-49d6-838a-46543ca54890 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:01.163770 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab68e46-6f8b-4e00-835b-e2267c6e9606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:01.164462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab68e46-6f8b-4e00-835b-e2267c6e9606 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.164749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab68e46-6f8b-4e00-835b-e2267c6e9606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.165035 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab68e46-6f8b-4e00-835b-e2267c6e9606 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:01.165738 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab68e46-6f8b-4e00-835b-e2267c6e9606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:01.167706 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab68e46-6f8b-4e00-835b-e2267c6e9606 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:01.249904 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1390/2773] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:14:01 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:14:01.255608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403ae0d-192b-4053-ab85-c5f78cd26c0e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:01.267229 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403ae0d-192b-4053-ab85-c5f78cd26c0e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:01.273060 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6280b-fe43-469f-8336-c6e91ae5e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:01.273733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6280b-fe43-469f-8336-c6e91ae5e254 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.274015 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6280b-fe43-469f-8336-c6e91ae5e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.275647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6280b-fe43-469f-8336-c6e91ae5e254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:01.275647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6280b-fe43-469f-8336-c6e91ae5e254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:01.276677 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6280b-fe43-469f-8336-c6e91ae5e254 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:01.288089 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1384/2774] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:01.292682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab68e46-6f8b-4e00-835b-e2267c6e9606 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:01.304553 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab68e46-6f8b-4e00-835b-e2267c6e9606 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:01.309224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2594a-f716-40b8-a637-ea170d8e4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:01.309885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2594a-f716-40b8-a637-ea170d8e4177 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.310455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2594a-f716-40b8-a637-ea170d8e4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.310614 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2594a-f716-40b8-a637-ea170d8e4177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:01.311338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2594a-f716-40b8-a637-ea170d8e4177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:01.313697 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2594a-f716-40b8-a637-ea170d8e4177 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:01.324257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1391/2775] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:01.328362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6280b-fe43-469f-8336-c6e91ae5e254 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:01.335878 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:01.340366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6280b-fe43-469f-8336-c6e91ae5e254 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:01.345891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6fbb4-36f6-4ca9-9fbc-d1b24f683449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:01.346833 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6fbb4-36f6-4ca9-9fbc-d1b24f683449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.347374 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6fbb4-36f6-4ca9-9fbc-d1b24f683449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.347652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6fbb4-36f6-4ca9-9fbc-d1b24f683449 admin admin] PATH_INFO: `/v3/projects/65f516f710cb43bd8400af95e1886b8d/users/ca107e949a7d4c1298c68dc04515c483/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:01.365082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6fbb4-36f6-4ca9-9fbc-d1b24f683449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f516f710cb43bd8400af95e1886b8d, user_id=ca107e949a7d4c1298c68dc04515c483, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:01.367829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6fbb4-36f6-4ca9-9fbc-d1b24f683449 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:01.461282 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1385/2776] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:01 2022] PUT /identity/v3/projects/65f516f710cb43bd8400af95e1886b8d/users/ca107e949a7d4c1298c68dc04515c483/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:01.471801 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220d659-1703-44eb-841c-a5af03e3cbbc None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.472352 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220d659-1703-44eb-841c-a5af03e3cbbc None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.472633 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220d659-1703-44eb-841c-a5af03e3cbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:01.503276 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-f220d659-1703-44eb-841c-a5af03e3cbbc None None] MFA Rules not processed for user `ca107e949a7d4c1298c68dc04515c483`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:01.504543 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f220d659-1703-44eb-841c-a5af03e3cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:01.510444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:01.578949 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1392/2777] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:01.584005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6fbb4-36f6-4ca9-9fbc-d1b24f683449 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:01.648949 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6fbb4-36f6-4ca9-9fbc-d1b24f683449 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:01.653793 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb30a74-3e48-470e-92d5-b556fffd6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:01.654475 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30a74-3e48-470e-92d5-b556fffd6971 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.654758 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30a74-3e48-470e-92d5-b556fffd6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.655086 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb30a74-3e48-470e-92d5-b556fffd6971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:01.655717 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb30a74-3e48-470e-92d5-b556fffd6971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:01.657711 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb30a74-3e48-470e-92d5-b556fffd6971 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:01.787094 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1386/2778] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:14:01 2022] POST /identity/v3/projects => generated 371 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:01.788319 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220d659-1703-44eb-841c-a5af03e3cbbc None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:01.799869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220d659-1703-44eb-841c-a5af03e3cbbc None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:01.857879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad51e8-39e2-43a8-80de-9d83aeeea5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:01.858579 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad51e8-39e2-43a8-80de-9d83aeeea5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.858950 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad51e8-39e2-43a8-80de-9d83aeeea5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.859177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad51e8-39e2-43a8-80de-9d83aeeea5d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:01.861015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad51e8-39e2-43a8-80de-9d83aeeea5d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:01.862616 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad51e8-39e2-43a8-80de-9d83aeeea5d8 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:01.935181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1393/2779] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:14:01 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:01.939123 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb30a74-3e48-470e-92d5-b556fffd6971 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:01.949480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb30a74-3e48-470e-92d5-b556fffd6971 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:01.954212 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22ad9-83f1-4772-9c85-36644d8c5ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:01.954850 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22ad9-83f1-4772-9c85-36644d8c5ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.955188 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22ad9-83f1-4772-9c85-36644d8c5ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.955409 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22ad9-83f1-4772-9c85-36644d8c5ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:01.956139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e22ad9-83f1-4772-9c85-36644d8c5ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:01.957723 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e22ad9-83f1-4772-9c85-36644d8c5ed6 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:01.969455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1387/2780] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:01.974020 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad51e8-39e2-43a8-80de-9d83aeeea5d8 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:01.984026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad51e8-39e2-43a8-80de-9d83aeeea5d8 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:01.989724 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9c9a7-e095-4113-bcbd-05286ef319d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:01.990690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c9a7-e095-4113-bcbd-05286ef319d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:01.990967 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c9a7-e095-4113-bcbd-05286ef319d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:01.991240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9c9a7-e095-4113-bcbd-05286ef319d0 admin admin] PATH_INFO: `/v3/projects/165c9e9098534d8c92ede0ae514dfefa/users/9e459ee73ffc4bb1a0e4c012957874b3/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:02.006264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9c9a7-e095-4113-bcbd-05286ef319d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165c9e9098534d8c92ede0ae514dfefa, user_id=9e459ee73ffc4bb1a0e4c012957874b3, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:02.008885 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9c9a7-e095-4113-bcbd-05286ef319d0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:02.089421 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1394/2781] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:01 2022] PUT /identity/v3/projects/165c9e9098534d8c92ede0ae514dfefa/users/9e459ee73ffc4bb1a0e4c012957874b3/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:02.093428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22ad9-83f1-4772-9c85-36644d8c5ed6 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:02.104424 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22ad9-83f1-4772-9c85-36644d8c5ed6 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:02.160055 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429c6d6-454e-4f76-8835-7660e160cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:02.160715 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c6d6-454e-4f76-8835-7660e160cef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:02.161000 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c6d6-454e-4f76-8835-7660e160cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:02.161285 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429c6d6-454e-4f76-8835-7660e160cef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:02.162007 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429c6d6-454e-4f76-8835-7660e160cef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:02.163620 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429c6d6-454e-4f76-8835-7660e160cef9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:02.173327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1388/2782] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:02.177542 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9c9a7-e095-4113-bcbd-05286ef319d0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:02.190676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9c9a7-e095-4113-bcbd-05286ef319d0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:02.192580 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:02.193455 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:02.193733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:02.194005 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] PATH_INFO: `/v3/projects/165c9e9098534d8c92ede0ae514dfefa/users/9e459ee73ffc4bb1a0e4c012957874b3/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:02.196008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=165c9e9098534d8c92ede0ae514dfefa, user_id=9e459ee73ffc4bb1a0e4c012957874b3, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:02.198687 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:02.209693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1395/2783] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:02 2022] PUT /identity/v3/projects/165c9e9098534d8c92ede0ae514dfefa/users/9e459ee73ffc4bb1a0e4c012957874b3/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:02.222477 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a295-73fb-49d1-90a4-403ba14f9edd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:02.222774 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a295-73fb-49d1-90a4-403ba14f9edd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:02.223107 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a295-73fb-49d1-90a4-403ba14f9edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:02.249464 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7714a295-73fb-49d1-90a4-403ba14f9edd None None] MFA Rules not processed for user `9e459ee73ffc4bb1a0e4c012957874b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:02.250856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7714a295-73fb-49d1-90a4-403ba14f9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:02.293357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:02.321661 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1389/2784] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:14:02.333889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:02.335584 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:02.395055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7d75c-f998-45c9-8ac4-18d39b6a7fcf admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:02.398744 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01245da-2682-4326-9b22-8da784a5509a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:02.399384 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01245da-2682-4326-9b22-8da784a5509a service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:02.399733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01245da-2682-4326-9b22-8da784a5509a service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:02.399947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01245da-2682-4326-9b22-8da784a5509a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:02.409872 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01245da-2682-4326-9b22-8da784a5509a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:02.411329 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01245da-2682-4326-9b22-8da784a5509a service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:02.420667 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1396/2785] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:02.612761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714a295-73fb-49d1-90a4-403ba14f9edd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:02.622491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714a295-73fb-49d1-90a4-403ba14f9edd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:02.626197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2091-eb4e-4410-bb2b-f726e7052bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:02.626840 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2091-eb4e-4410-bb2b-f726e7052bbe service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:02.627125 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2091-eb4e-4410-bb2b-f726e7052bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:02.627402 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2091-eb4e-4410-bb2b-f726e7052bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:02.684906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee2091-eb4e-4410-bb2b-f726e7052bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:02.686381 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee2091-eb4e-4410-bb2b-f726e7052bbe service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:02.695403 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1390/2786] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:12.416665 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:12.691427 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=39 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:46.187234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01245da-2682-4326-9b22-8da784a5509a service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:46.257252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01245da-2682-4326-9b22-8da784a5509a service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:46.258727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:46.259630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:46.259914 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:46.260192 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] PATH_INFO: `/v3/users/ca107e949a7d4c1298c68dc04515c483` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:46.261429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca107e949a7d4c1298c68dc04515c483)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:46.263441 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:46.444756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca107e949a7d4c1298c68dc04515c483'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:46.445418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca107e949a7d4c1298c68dc04515c483'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:46.446019 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca107e949a7d4c1298c68dc04515c483'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:46.522471 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca107e949a7d4c1298c68dc04515c483'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:46.536604 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca107e949a7d4c1298c68dc04515c483'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:46.548315 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1397/2787] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:14:46 2022] DELETE /identity/v3/users/ca107e949a7d4c1298c68dc04515c483 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:46.553096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010644a-785a-4980-8192-cf14b94aa0f8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:46.553660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010644a-785a-4980-8192-cf14b94aa0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:46.553660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010644a-785a-4980-8192-cf14b94aa0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:46.571584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0010644a-785a-4980-8192-cf14b94aa0f8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:46.572782 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0010644a-785a-4980-8192-cf14b94aa0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:46.631795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1391/2788] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:14:46.641577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:46.643043 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:46.723228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a92f-b0c4-41e5-a965-906fa5c1c29c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:46.726893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ed7f2-2a5d-4730-941a-5bb4ae61171b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:46.727541 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed7f2-2a5d-4730-941a-5bb4ae61171b service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:46.727821 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed7f2-2a5d-4730-941a-5bb4ae61171b service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:46.728090 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ed7f2-2a5d-4730-941a-5bb4ae61171b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:46.737477 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ed7f2-2a5d-4730-941a-5bb4ae61171b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:46.738970 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ed7f2-2a5d-4730-941a-5bb4ae61171b service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:46.748895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1398/2789] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:47.141347 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010644a-785a-4980-8192-cf14b94aa0f8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:47.143846 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0010644a-785a-4980-8192-cf14b94aa0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:47.155038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010644a-785a-4980-8192-cf14b94aa0f8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:47.160367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:47.161294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:47.161750 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:47.162031 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] PATH_INFO: `/v3/projects/65f516f710cb43bd8400af95e1886b8d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:47.163278 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f516f710cb43bd8400af95e1886b8d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:47.165418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:47.255005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f516f710cb43bd8400af95e1886b8d', 'request_id': 'req-91fea50d-5e87-48b2-ab06-f13532c19df2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.260491 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f516f710cb43bd8400af95e1886b8d', 'request_id': 'req-91fea50d-5e87-48b2-ab06-f13532c19df2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.322030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f516f710cb43bd8400af95e1886b8d', 'request_id': 'req-91fea50d-5e87-48b2-ab06-f13532c19df2'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.333726 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] The token cache is being invalidate because project 65f516f710cb43bd8400af95e1886b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:14:47.335907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.335907 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.336303 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1392/2790] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:47 2022] DELETE /identity/v3/projects/65f516f710cb43bd8400af95e1886b8d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:47.340510 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ed7f2-2a5d-4730-941a-5bb4ae61171b service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:47.345385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:47.351839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ed7f2-2a5d-4730-941a-5bb4ae61171b service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:47.410401 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:47.411920 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:47.412224 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:47.412521 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] PATH_INFO: `/v3/users/9e459ee73ffc4bb1a0e4c012957874b3` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:47.413726 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e459ee73ffc4bb1a0e4c012957874b3)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:47.415699 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:47.605512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e459ee73ffc4bb1a0e4c012957874b3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.606211 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e459ee73ffc4bb1a0e4c012957874b3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.606826 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e459ee73ffc4bb1a0e4c012957874b3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.699587 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e459ee73ffc4bb1a0e4c012957874b3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.713143 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-511990d1-ca44-4e58-847f-5f952d43e4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e459ee73ffc4bb1a0e4c012957874b3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:47.726733 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1399/2791] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:14:47 2022] DELETE /identity/v3/users/9e459ee73ffc4bb1a0e4c012957874b3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:48.141077 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:48.142546 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:48.157020 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fea50d-5e87-48b2-ab06-f13532c19df2 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:48.217412 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:48.218221 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.218503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.218776 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] PATH_INFO: `/v3/projects/165c9e9098534d8c92ede0ae514dfefa` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.219970 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=165c9e9098534d8c92ede0ae514dfefa)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:48.222161 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:48.329361 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:48.348127 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165c9e9098534d8c92ede0ae514dfefa', 'request_id': 'req-c3dd774d-3392-4546-b5d0-513c551b1d46'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:48.353892 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165c9e9098534d8c92ede0ae514dfefa', 'request_id': 'req-c3dd774d-3392-4546-b5d0-513c551b1d46'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:48.413535 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165c9e9098534d8c92ede0ae514dfefa', 'request_id': 'req-c3dd774d-3392-4546-b5d0-513c551b1d46'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:48.425335 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] The token cache is being invalidate because project 165c9e9098534d8c92ede0ae514dfefa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:14:48.425876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:48.426930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-c3dd774d-3392-4546-b5d0-513c551b1d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:48.429294 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1393/2792] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:48 2022] DELETE /identity/v3/projects/165c9e9098534d8c92ede0ae514dfefa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:48.434231 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fbe3-9b73-495b-be8f-b6157a04843b None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.434760 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fbe3-9b73-495b-be8f-b6157a04843b None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.434862 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35fbe3-9b73-495b-be8f-b6157a04843b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.453632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0a35fbe3-9b73-495b-be8f-b6157a04843b None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:48.454860 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0a35fbe3-9b73-495b-be8f-b6157a04843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:48.515182 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1400/2793] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:48.523544 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee3508-cf77-410e-a4f1-b3146039248c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.523843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee3508-cf77-410e-a4f1-b3146039248c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.524132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee3508-cf77-410e-a4f1-b3146039248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.542780 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-16ee3508-cf77-410e-a4f1-b3146039248c None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:48.543997 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-16ee3508-cf77-410e-a4f1-b3146039248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:48.551895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1394/2794] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:48.556863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35fbe3-9b73-495b-be8f-b6157a04843b None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:48.566632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35fbe3-9b73-495b-be8f-b6157a04843b None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:48.572197 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:48.572838 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.573161 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.573387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.574139 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:14:48.574451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:48.576040 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:48.588620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1401/2795] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:14:48.593006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee3508-cf77-410e-a4f1-b3146039248c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:48.603416 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee3508-cf77-410e-a4f1-b3146039248c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:48.608240 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205efb2-bad8-4245-b03b-af5d28639233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:48.608925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205efb2-bad8-4245-b03b-af5d28639233 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.609208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205efb2-bad8-4245-b03b-af5d28639233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.609490 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205efb2-bad8-4245-b03b-af5d28639233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.610220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205efb2-bad8-4245-b03b-af5d28639233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:48.614984 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205efb2-bad8-4245-b03b-af5d28639233 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:48.690095 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1395/2796] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:14:48 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:48.694722 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:48.705644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71f180-2e0e-440d-96d5-f6666863e817 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:48.712165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:48.763029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f951f4-7b52-482d-8b8a-b13b1425e3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:48.763712 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f951f4-7b52-482d-8b8a-b13b1425e3ab admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.763998 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f951f4-7b52-482d-8b8a-b13b1425e3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.764275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f951f4-7b52-482d-8b8a-b13b1425e3ab admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.764981 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f951f4-7b52-482d-8b8a-b13b1425e3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:48.767133 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f951f4-7b52-482d-8b8a-b13b1425e3ab admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:48.837017 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1402/2797] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:14:48 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:48.841207 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205efb2-bad8-4245-b03b-af5d28639233 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:48.853366 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205efb2-bad8-4245-b03b-af5d28639233 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:48.858709 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70892-78af-4ec6-a162-b8030503fc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:48.859368 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70892-78af-4ec6-a162-b8030503fc22 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.859652 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70892-78af-4ec6-a162-b8030503fc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.859930 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70892-78af-4ec6-a162-b8030503fc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.860660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d70892-78af-4ec6-a162-b8030503fc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:48.862270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d70892-78af-4ec6-a162-b8030503fc22 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:48.873651 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1396/2798] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:48.877644 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f951f4-7b52-482d-8b8a-b13b1425e3ab admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:48.887886 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f951f4-7b52-482d-8b8a-b13b1425e3ab admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:48.892434 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26589f05-bdd2-46fb-96f1-98a1a6070dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:48.893083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589f05-bdd2-46fb-96f1-98a1a6070dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.893365 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589f05-bdd2-46fb-96f1-98a1a6070dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.893642 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26589f05-bdd2-46fb-96f1-98a1a6070dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.894472 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26589f05-bdd2-46fb-96f1-98a1a6070dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:48.896064 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26589f05-bdd2-46fb-96f1-98a1a6070dd4 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:48.905972 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1403/2799] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:48.910104 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70892-78af-4ec6-a162-b8030503fc22 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:48.920455 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70892-78af-4ec6-a162-b8030503fc22 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:48.925071 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475edb8-c6d7-4b2f-bd14-3adc8639e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:48.926021 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475edb8-c6d7-4b2f-bd14-3adc8639e03f admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:48.926327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475edb8-c6d7-4b2f-bd14-3adc8639e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:48.926606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475edb8-c6d7-4b2f-bd14-3adc8639e03f admin admin] PATH_INFO: `/v3/projects/371f289c69964a1587bce2e7b33d694e/users/a8b0b85e0eee4b288c25262f57c18468/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:48.941636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475edb8-c6d7-4b2f-bd14-3adc8639e03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=371f289c69964a1587bce2e7b33d694e, user_id=a8b0b85e0eee4b288c25262f57c18468, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:48.944517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475edb8-c6d7-4b2f-bd14-3adc8639e03f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:48.997566 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1397/2800] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:48 2022] PUT /identity/v3/projects/371f289c69964a1587bce2e7b33d694e/users/a8b0b85e0eee4b288c25262f57c18468/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:49.009164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f2ff9-897c-406b-909f-a9e13a0a0d1d None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.011594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f2ff9-897c-406b-909f-a9e13a0a0d1d None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.011594 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f2ff9-897c-406b-909f-a9e13a0a0d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.036234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-4d9f2ff9-897c-406b-909f-a9e13a0a0d1d None None] MFA Rules not processed for user `a8b0b85e0eee4b288c25262f57c18468`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:49.038029 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4d9f2ff9-897c-406b-909f-a9e13a0a0d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:49.102302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1404/2801] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:49.106811 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475edb8-c6d7-4b2f-bd14-3adc8639e03f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:49.170698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475edb8-c6d7-4b2f-bd14-3adc8639e03f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:49.175338 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c38ff5-e426-4b98-ac8a-6136b66bbccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:49.175994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c38ff5-e426-4b98-ac8a-6136b66bbccb admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.176279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c38ff5-e426-4b98-ac8a-6136b66bbccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.176557 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c38ff5-e426-4b98-ac8a-6136b66bbccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.177248 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c38ff5-e426-4b98-ac8a-6136b66bbccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:49.179176 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c38ff5-e426-4b98-ac8a-6136b66bbccb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:49.254820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1398/2802] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:14:49 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:49.259134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f2ff9-897c-406b-909f-a9e13a0a0d1d None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:49.270112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f2ff9-897c-406b-909f-a9e13a0a0d1d None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:49.326411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ca15c-b7b9-4835-b989-93fbd8d9c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:49.326992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ca15c-b7b9-4835-b989-93fbd8d9c709 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.327274 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ca15c-b7b9-4835-b989-93fbd8d9c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.327547 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ca15c-b7b9-4835-b989-93fbd8d9c709 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.328234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ca15c-b7b9-4835-b989-93fbd8d9c709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:49.330134 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ca15c-b7b9-4835-b989-93fbd8d9c709 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:49.390725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1405/2803] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:14:49 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:49.394800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c38ff5-e426-4b98-ac8a-6136b66bbccb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:49.405707 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c38ff5-e426-4b98-ac8a-6136b66bbccb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:49.410330 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3234841-3ff3-4307-8416-de3526cc3f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:49.410979 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3234841-3ff3-4307-8416-de3526cc3f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.411266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3234841-3ff3-4307-8416-de3526cc3f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.412084 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3234841-3ff3-4307-8416-de3526cc3f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.412820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3234841-3ff3-4307-8416-de3526cc3f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:49.414440 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3234841-3ff3-4307-8416-de3526cc3f70 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:49.424804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1399/2804] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:49.428890 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ca15c-b7b9-4835-b989-93fbd8d9c709 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:49.438947 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ca15c-b7b9-4835-b989-93fbd8d9c709 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:49.443600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1998705-47af-48d1-a28d-01a54fa04b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:49.445030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998705-47af-48d1-a28d-01a54fa04b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.445030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998705-47af-48d1-a28d-01a54fa04b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.445030 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998705-47af-48d1-a28d-01a54fa04b2a admin admin] PATH_INFO: `/v3/projects/0248a0e92c8f46909fa25cfb46128eb2/users/342e39f09f114b6c96cb830efd0ea1b1/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.447340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:49.461245 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1998705-47af-48d1-a28d-01a54fa04b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0248a0e92c8f46909fa25cfb46128eb2, user_id=342e39f09f114b6c96cb830efd0ea1b1, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:49.463889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1998705-47af-48d1-a28d-01a54fa04b2a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:49.528659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1406/2805] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:49 2022] PUT /identity/v3/projects/0248a0e92c8f46909fa25cfb46128eb2/users/342e39f09f114b6c96cb830efd0ea1b1/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:49.532847 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3234841-3ff3-4307-8416-de3526cc3f70 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:49.543446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3234841-3ff3-4307-8416-de3526cc3f70 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:49.563829 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:49.601725 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921becb-eb09-4bf6-bfca-5a1e00f8414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:49.602345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921becb-eb09-4bf6-bfca-5a1e00f8414f admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.602629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921becb-eb09-4bf6-bfca-5a1e00f8414f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.602905 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921becb-eb09-4bf6-bfca-5a1e00f8414f admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.603635 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921becb-eb09-4bf6-bfca-5a1e00f8414f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:49.605235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921becb-eb09-4bf6-bfca-5a1e00f8414f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:49.615468 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1400/2806] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:49.619350 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1998705-47af-48d1-a28d-01a54fa04b2a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:49.629940 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1998705-47af-48d1-a28d-01a54fa04b2a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:49.635561 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:49.636469 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.636749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.637026 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] PATH_INFO: `/v3/projects/0248a0e92c8f46909fa25cfb46128eb2/users/342e39f09f114b6c96cb830efd0ea1b1/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.639034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0248a0e92c8f46909fa25cfb46128eb2, user_id=342e39f09f114b6c96cb830efd0ea1b1, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:49.641666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:49.652531 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1407/2807] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:49 2022] PUT /identity/v3/projects/0248a0e92c8f46909fa25cfb46128eb2/users/342e39f09f114b6c96cb830efd0ea1b1/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:49.662936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3cfe2-212d-4e21-9bfe-25ff17b2b4e3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.663266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3cfe2-212d-4e21-9bfe-25ff17b2b4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.663545 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3cfe2-212d-4e21-9bfe-25ff17b2b4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.689955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6aa3cfe2-212d-4e21-9bfe-25ff17b2b4e3 None None] MFA Rules not processed for user `342e39f09f114b6c96cb830efd0ea1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:49.691217 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6aa3cfe2-212d-4e21-9bfe-25ff17b2b4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:49.759211 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1401/2808] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:49.771361 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:49.773116 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:49.830270 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b57da-8982-4926-b0c8-74dad72d473f admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:49.834848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7fd66-444f-4205-b5be-ce65ae5fdca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:49.835498 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7fd66-444f-4205-b5be-ce65ae5fdca6 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:49.835783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7fd66-444f-4205-b5be-ce65ae5fdca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:49.836061 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7fd66-444f-4205-b5be-ce65ae5fdca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:49.845168 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7fd66-444f-4205-b5be-ce65ae5fdca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:49.846859 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7fd66-444f-4205-b5be-ce65ae5fdca6 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:49.856476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1408/2809] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:49 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:50.039741 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3cfe2-212d-4e21-9bfe-25ff17b2b4e3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:50.041340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6aa3cfe2-212d-4e21-9bfe-25ff17b2b4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:50.054137 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3cfe2-212d-4e21-9bfe-25ff17b2b4e3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:50.057630 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884602eb-9a34-43e5-a405-97b3758a515c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:50.058380 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884602eb-9a34-43e5-a405-97b3758a515c service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:50.058693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884602eb-9a34-43e5-a405-97b3758a515c service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:50.058971 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884602eb-9a34-43e5-a405-97b3758a515c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:50.117450 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884602eb-9a34-43e5-a405-97b3758a515c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:50.118823 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884602eb-9a34-43e5-a405-97b3758a515c service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:50.127602 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1402/2810] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:14:54.656325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7fd66-444f-4205-b5be-ce65ae5fdca6 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:54.718871 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7fd66-444f-4205-b5be-ce65ae5fdca6 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:54.724740 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:54.725793 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:54.726101 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:54.726381 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] PATH_INFO: `/v3/users/a8b0b85e0eee4b288c25262f57c18468` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:54.727575 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b0b85e0eee4b288c25262f57c18468)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:54.729483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:54.913669 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b0b85e0eee4b288c25262f57c18468'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:54.914279 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b0b85e0eee4b288c25262f57c18468'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:54.914908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b0b85e0eee4b288c25262f57c18468'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:54.979240 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b0b85e0eee4b288c25262f57c18468'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:54.991805 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b0b85e0eee4b288c25262f57c18468'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:54.993879 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:55.004537 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1409/2811] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:14:54 2022] DELETE /identity/v3/users/a8b0b85e0eee4b288c25262f57c18468 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:14:55.009732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee657-f17b-411d-b7ec-b8b052b367fd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:55.023656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee657-f17b-411d-b7ec-b8b052b367fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:55.023656 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee657-f17b-411d-b7ec-b8b052b367fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:55.028841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-708ee657-f17b-411d-b7ec-b8b052b367fd None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:55.030105 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-708ee657-f17b-411d-b7ec-b8b052b367fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:55.070345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:55.090637 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1403/2812] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 09:14:55.101371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:55.103158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:55.167142 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d8201-e5d2-4deb-93f9-c44a0ddc35fc admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:55.171503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a537c-630d-46f1-8757-46469e32b23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:55.172228 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a537c-630d-46f1-8757-46469e32b23e service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:55.172512 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a537c-630d-46f1-8757-46469e32b23e service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:55.172788 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a537c-630d-46f1-8757-46469e32b23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:55.183992 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a537c-630d-46f1-8757-46469e32b23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:55.185577 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a537c-630d-46f1-8757-46469e32b23e service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:55.196620 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1410/2813] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:55.656810 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee657-f17b-411d-b7ec-b8b052b367fd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:55.659201 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-708ee657-f17b-411d-b7ec-b8b052b367fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:55.678555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee657-f17b-411d-b7ec-b8b052b367fd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:55.689068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:55.692042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:55.692042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:55.692042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] PATH_INFO: `/v3/projects/371f289c69964a1587bce2e7b33d694e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:55.692042 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=371f289c69964a1587bce2e7b33d694e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:55.694870 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:55.814075 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371f289c69964a1587bce2e7b33d694e', 'request_id': 'req-588af03f-1f35-442d-92a9-979c4d293a43'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:55.820485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371f289c69964a1587bce2e7b33d694e', 'request_id': 'req-588af03f-1f35-442d-92a9-979c4d293a43'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:55.911136 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371f289c69964a1587bce2e7b33d694e', 'request_id': 'req-588af03f-1f35-442d-92a9-979c4d293a43'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:55.923549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] The token cache is being invalidate because project 371f289c69964a1587bce2e7b33d694e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:14:55.923836 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:55.924529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:55.926035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1404/2814] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:55 2022] DELETE /identity/v3/projects/371f289c69964a1587bce2e7b33d694e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:55.930874 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a537c-630d-46f1-8757-46469e32b23e service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:55.943102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a537c-630d-46f1-8757-46469e32b23e service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:56.000373 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:56.001273 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:56.001551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:56.001822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] PATH_INFO: `/v3/users/342e39f09f114b6c96cb830efd0ea1b1` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:56.004566 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=342e39f09f114b6c96cb830efd0ea1b1)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:56.007167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:56.227962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342e39f09f114b6c96cb830efd0ea1b1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:56.228628 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342e39f09f114b6c96cb830efd0ea1b1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:56.229235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342e39f09f114b6c96cb830efd0ea1b1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:56.311173 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342e39f09f114b6c96cb830efd0ea1b1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:56.324461 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-3541d445-4658-4205-98aa-e689272dc771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342e39f09f114b6c96cb830efd0ea1b1'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:56.336932 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1411/2815] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:14:55 2022] DELETE /identity/v3/users/342e39f09f114b6c96cb830efd0ea1b1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:56.718228 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:56.719896 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:56.735732 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588af03f-1f35-442d-92a9-979c4d293a43 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:56.796527 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:56.797446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:56.797729 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:56.798008 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] PATH_INFO: `/v3/projects/0248a0e92c8f46909fa25cfb46128eb2` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:56.799317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0248a0e92c8f46909fa25cfb46128eb2)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:56.801202 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:56.933685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0248a0e92c8f46909fa25cfb46128eb2', 'request_id': 'req-4e91cd0d-7fd4-4988-b080-eb731be14499'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:56.939099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0248a0e92c8f46909fa25cfb46128eb2', 'request_id': 'req-4e91cd0d-7fd4-4988-b080-eb731be14499'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.013493 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0248a0e92c8f46909fa25cfb46128eb2', 'request_id': 'req-4e91cd0d-7fd4-4988-b080-eb731be14499'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.020989 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:57.026038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] The token cache is being invalidate because project 0248a0e92c8f46909fa25cfb46128eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:14:57.026332 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.027050 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-4e91cd0d-7fd4-4988-b080-eb731be14499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:14:57.028702 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1405/2816] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:14:56 2022] DELETE /identity/v3/projects/0248a0e92c8f46909fa25cfb46128eb2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:57.033789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d256-a7cd-4e2c-b598-e50b19f02a1e None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.034343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d256-a7cd-4e2c-b598-e50b19f02a1e None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.034488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572d256-a7cd-4e2c-b598-e50b19f02a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.052963 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-6572d256-a7cd-4e2c-b598-e50b19f02a1e None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:57.054257 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-6572d256-a7cd-4e2c-b598-e50b19f02a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:57.062691 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:57.114523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1412/2817] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:57.122950 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f9318-2cb5-4db7-8acc-dde8f88b5ccd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.123235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f9318-2cb5-4db7-8acc-dde8f88b5ccd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.123517 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f9318-2cb5-4db7-8acc-dde8f88b5ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.142048 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d15f9318-2cb5-4db7-8acc-dde8f88b5ccd None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:57.143270 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d15f9318-2cb5-4db7-8acc-dde8f88b5ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:57.151895 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1406/2818] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:57.157429 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d256-a7cd-4e2c-b598-e50b19f02a1e None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:57.167742 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572d256-a7cd-4e2c-b598-e50b19f02a1e None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:57.172601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:57.173265 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.173551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.173836 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.174606 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:14:57.177868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:57.177868 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:57.188428 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1413/2819] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:14:57.193377 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f9318-2cb5-4db7-8acc-dde8f88b5ccd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:57.202813 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f9318-2cb5-4db7-8acc-dde8f88b5ccd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:57.208026 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5aed2-291f-4b2f-9322-fc3d389791fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:57.209367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5aed2-291f-4b2f-9322-fc3d389791fe admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.209653 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5aed2-291f-4b2f-9322-fc3d389791fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.209929 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5aed2-291f-4b2f-9322-fc3d389791fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.210698 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5aed2-291f-4b2f-9322-fc3d389791fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:57.212742 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5aed2-291f-4b2f-9322-fc3d389791fe admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:57.335719 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1407/2820] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:14:57 2022] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:57.339729 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:57.351406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf35d56-a268-4be9-bbef-6a858aa71a93 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:57.407446 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4218f6-f70c-46f4-bf4c-070da1d93a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:57.408106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4218f6-f70c-46f4-bf4c-070da1d93a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.408385 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4218f6-f70c-46f4-bf4c-070da1d93a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.408659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4218f6-f70c-46f4-bf4c-070da1d93a91 admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.409346 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4218f6-f70c-46f4-bf4c-070da1d93a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:57.411984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4218f6-f70c-46f4-bf4c-070da1d93a91 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:57.529436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1414/2821] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:14:57 2022] POST /identity/v3/users => generated 305 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:57.533326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5aed2-291f-4b2f-9322-fc3d389791fe admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:57.544616 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5aed2-291f-4b2f-9322-fc3d389791fe admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:57.549624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fee92-70f2-4b48-9f99-6dc44e9dc869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:57.550334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fee92-70f2-4b48-9f99-6dc44e9dc869 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.550621 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fee92-70f2-4b48-9f99-6dc44e9dc869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.550902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fee92-70f2-4b48-9f99-6dc44e9dc869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.551820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fee92-70f2-4b48-9f99-6dc44e9dc869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:57.553510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fee92-70f2-4b48-9f99-6dc44e9dc869 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:57.563910 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1408/2822] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:57.568375 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4218f6-f70c-46f4-bf4c-070da1d93a91 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:57.578338 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4218f6-f70c-46f4-bf4c-070da1d93a91 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:57.583526 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae07f9-ebf1-41b8-a744-07da6cefe8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:57.584179 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae07f9-ebf1-41b8-a744-07da6cefe8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.584467 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae07f9-ebf1-41b8-a744-07da6cefe8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.584745 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae07f9-ebf1-41b8-a744-07da6cefe8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.585462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae07f9-ebf1-41b8-a744-07da6cefe8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:57.587112 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae07f9-ebf1-41b8-a744-07da6cefe8ed admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:57.597185 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1415/2823] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:57.602012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fee92-70f2-4b48-9f99-6dc44e9dc869 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:57.611879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fee92-70f2-4b48-9f99-6dc44e9dc869 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:57.616459 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab4e2-9e17-49db-86ce-8ed1337a6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:57.617326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab4e2-9e17-49db-86ce-8ed1337a6db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.617626 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab4e2-9e17-49db-86ce-8ed1337a6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.617875 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab4e2-9e17-49db-86ce-8ed1337a6db5 admin admin] PATH_INFO: `/v3/projects/7a11417e4cf049ee8d01b1c66598ee7f/users/3776cee98a5d4a779243c3a54717c515/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.633079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ab4e2-9e17-49db-86ce-8ed1337a6db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a11417e4cf049ee8d01b1c66598ee7f, user_id=3776cee98a5d4a779243c3a54717c515, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:57.635801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ab4e2-9e17-49db-86ce-8ed1337a6db5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:57.734306 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1409/2824] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:57 2022] PUT /identity/v3/projects/7a11417e4cf049ee8d01b1c66598ee7f/users/3776cee98a5d4a779243c3a54717c515/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:57.747517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b76a-645a-4113-b656-7b1ca21d75d1 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.747915 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b76a-645a-4113-b656-7b1ca21d75d1 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.748193 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b76a-645a-4113-b656-7b1ca21d75d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.776578 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-8e55b76a-645a-4113-b656-7b1ca21d75d1 None None] MFA Rules not processed for user `3776cee98a5d4a779243c3a54717c515`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:57.777834 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-8e55b76a-645a-4113-b656-7b1ca21d75d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:57.843814 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1416/2825] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:57.848805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab4e2-9e17-49db-86ce-8ed1337a6db5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:57.913223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab4e2-9e17-49db-86ce-8ed1337a6db5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:57.918519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e74a08-0343-4684-ad18-c04d09f69ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:57.919524 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e74a08-0343-4684-ad18-c04d09f69ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:57.919814 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e74a08-0343-4684-ad18-c04d09f69ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:57.920096 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e74a08-0343-4684-ad18-c04d09f69ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:57.920819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e74a08-0343-4684-ad18-c04d09f69ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:57.922801 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e74a08-0343-4684-ad18-c04d09f69ea9 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:58.027889 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1410/2826] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:14:57 2022] POST /identity/v3/projects => generated 407 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:14:58.032049 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55b76a-645a-4113-b656-7b1ca21d75d1 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:58.043344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55b76a-645a-4113-b656-7b1ca21d75d1 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:58.047906 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:58.101008 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034458c-63a5-4d29-addf-1f566016f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:58.101602 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034458c-63a5-4d29-addf-1f566016f50b admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.101893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034458c-63a5-4d29-addf-1f566016f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.102207 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034458c-63a5-4d29-addf-1f566016f50b admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.102901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034458c-63a5-4d29-addf-1f566016f50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:58.104852 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034458c-63a5-4d29-addf-1f566016f50b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:58.180693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1417/2827] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:14:58 2022] POST /identity/v3/users => generated 310 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:14:58.185099 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e74a08-0343-4684-ad18-c04d09f69ea9 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:58.196371 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e74a08-0343-4684-ad18-c04d09f69ea9 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:58.201239 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf241d74-757a-426a-815b-8bed96f4e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:58.201902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf241d74-757a-426a-815b-8bed96f4e375 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.202223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf241d74-757a-426a-815b-8bed96f4e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.202499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf241d74-757a-426a-815b-8bed96f4e375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.203250 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf241d74-757a-426a-815b-8bed96f4e375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:58.207733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf241d74-757a-426a-815b-8bed96f4e375 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:58.216944 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1411/2828] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:14:58.221523 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034458c-63a5-4d29-addf-1f566016f50b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:58.231746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034458c-63a5-4d29-addf-1f566016f50b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:58.236406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ff195-f14f-4155-a8c9-903aa199f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:58.237344 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ff195-f14f-4155-a8c9-903aa199f0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.237683 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ff195-f14f-4155-a8c9-903aa199f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.237962 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ff195-f14f-4155-a8c9-903aa199f0c1 admin admin] PATH_INFO: `/v3/projects/de2d3933bd0d4e0a9389868681fbd0e7/users/e2e837a80cbe41a98c025412095fe9cd/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.253418 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ff195-f14f-4155-a8c9-903aa199f0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2d3933bd0d4e0a9389868681fbd0e7, user_id=e2e837a80cbe41a98c025412095fe9cd, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:58.256869 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ff195-f14f-4155-a8c9-903aa199f0c1 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:58.317275 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1418/2829] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:58 2022] PUT /identity/v3/projects/de2d3933bd0d4e0a9389868681fbd0e7/users/e2e837a80cbe41a98c025412095fe9cd/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:58.322132 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf241d74-757a-426a-815b-8bed96f4e375 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:58.332223 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf241d74-757a-426a-815b-8bed96f4e375 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:58.390696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0a64-6db4-4cff-9982-8385e35ff6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:58.391283 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0a64-6db4-4cff-9982-8385e35ff6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.391598 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0a64-6db4-4cff-9982-8385e35ff6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.391882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0a64-6db4-4cff-9982-8385e35ff6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.392615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e0a64-6db4-4cff-9982-8385e35ff6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:58.394233 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e0a64-6db4-4cff-9982-8385e35ff6f5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:58.404247 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1412/2830] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:14:58.408548 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ff195-f14f-4155-a8c9-903aa199f0c1 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:58.418916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ff195-f14f-4155-a8c9-903aa199f0c1 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:58.423875 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:58.424832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.425243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.425494 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] PATH_INFO: `/v3/projects/de2d3933bd0d4e0a9389868681fbd0e7/users/e2e837a80cbe41a98c025412095fe9cd/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.428155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2d3933bd0d4e0a9389868681fbd0e7, user_id=e2e837a80cbe41a98c025412095fe9cd, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:58.430808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:58.440901 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1419/2831] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:14:58 2022] PUT /identity/v3/projects/de2d3933bd0d4e0a9389868681fbd0e7/users/e2e837a80cbe41a98c025412095fe9cd/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:14:58.452396 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d841-5109-4e6e-b7a2-b87ca385a213 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.452690 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d841-5109-4e6e-b7a2-b87ca385a213 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.452970 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96d841-5109-4e6e-b7a2-b87ca385a213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.460208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:14:58.480438 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dc96d841-5109-4e6e-b7a2-b87ca385a213 None None] MFA Rules not processed for user `e2e837a80cbe41a98c025412095fe9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:14:58.481682 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dc96d841-5109-4e6e-b7a2-b87ca385a213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:58.551718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1413/2832] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:14:58 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:14:58.562997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:58.564681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:14:58.622637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377c3e2-70dc-44c7-b55f-8399a06fe89d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:58.626331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190553b-41e9-46d9-9f42-ced97cf99f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:58.626975 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190553b-41e9-46d9-9f42-ced97cf99f2a service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:58.627258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190553b-41e9-46d9-9f42-ced97cf99f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:58.627535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190553b-41e9-46d9-9f42-ced97cf99f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:58.636598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190553b-41e9-46d9-9f42-ced97cf99f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:58.638010 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190553b-41e9-46d9-9f42-ced97cf99f2a service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:58.648083 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1420/2833] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:58 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:14:59.030931 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d841-5109-4e6e-b7a2-b87ca385a213 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:14:59.041596 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96d841-5109-4e6e-b7a2-b87ca385a213 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:14:59.045304 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d537b-7029-4e53-9527-c1812f42bdb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:14:59.045945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d537b-7029-4e53-9527-c1812f42bdb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:14:59.052885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d537b-7029-4e53-9527-c1812f42bdb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:14:59.052885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d537b-7029-4e53-9527-c1812f42bdb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:14:59.104418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d537b-7029-4e53-9527-c1812f42bdb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:14:59.105879 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d537b-7029-4e53-9527-c1812f42bdb5 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:14:59.115311 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1414/2834] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:14:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:08.003919 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190553b-41e9-46d9-9f42-ced97cf99f2a service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:08.067050 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190553b-41e9-46d9-9f42-ced97cf99f2a service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:08.072564 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:08.073436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:08.073717 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:08.073994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] PATH_INFO: `/v3/users/3776cee98a5d4a779243c3a54717c515` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:08.075205 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3776cee98a5d4a779243c3a54717c515)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:08.077113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:08.081682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:08.238676 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3776cee98a5d4a779243c3a54717c515'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.239335 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3776cee98a5d4a779243c3a54717c515'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.239934 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3776cee98a5d4a779243c3a54717c515'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.293194 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3776cee98a5d4a779243c3a54717c515'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.306246 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3776cee98a5d4a779243c3a54717c515'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:08.319234 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1421/2835] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:08 2022] DELETE /identity/v3/users/3776cee98a5d4a779243c3a54717c515 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:08.323817 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564aa3b-cc03-4387-87aa-a31570a40af5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:08.324297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564aa3b-cc03-4387-87aa-a31570a40af5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:08.324398 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564aa3b-cc03-4387-87aa-a31570a40af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:08.341815 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7564aa3b-cc03-4387-87aa-a31570a40af5 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:08.343053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7564aa3b-cc03-4387-87aa-a31570a40af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:08.404693 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1415/2836] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:08.414617 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:08.416053 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:08.473558 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3870520-0f2e-4fb7-8976-444bd6c2c661 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:08.477300 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb741c0-f166-49f4-8a00-1ae53436f00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:08.477955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb741c0-f166-49f4-8a00-1ae53436f00f service neutron] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:08.478340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb741c0-f166-49f4-8a00-1ae53436f00f service neutron] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:08.478623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb741c0-f166-49f4-8a00-1ae53436f00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:08.488881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb741c0-f166-49f4-8a00-1ae53436f00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:08.490264 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb741c0-f166-49f4-8a00-1ae53436f00f service neutron] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:08.500497 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1422/2837] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:08.918166 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564aa3b-cc03-4387-87aa-a31570a40af5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:08.919964 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7564aa3b-cc03-4387-87aa-a31570a40af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:08.933839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564aa3b-cc03-4387-87aa-a31570a40af5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:08.938936 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:08.939816 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:08.940117 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:08.940520 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] PATH_INFO: `/v3/projects/7a11417e4cf049ee8d01b1c66598ee7f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:08.941789 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a11417e4cf049ee8d01b1c66598ee7f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:08.943790 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:08.971208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:09.094429 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a11417e4cf049ee8d01b1c66598ee7f', 'request_id': 'req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.100122 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a11417e4cf049ee8d01b1c66598ee7f', 'request_id': 'req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.179230 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a11417e4cf049ee8d01b1c66598ee7f', 'request_id': 'req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.191205 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] The token cache is being invalidate because project 7a11417e4cf049ee8d01b1c66598ee7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:09.191492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.192124 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.193695 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1416/2838] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:08 2022] DELETE /identity/v3/projects/7a11417e4cf049ee8d01b1c66598ee7f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:09.198295 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb741c0-f166-49f4-8a00-1ae53436f00f service neutron] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.208321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb741c0-f166-49f4-8a00-1ae53436f00f service neutron] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:09.264802 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:09.265666 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:09.265945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:09.266254 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] PATH_INFO: `/v3/users/e2e837a80cbe41a98c025412095fe9cd` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:09.267433 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e837a80cbe41a98c025412095fe9cd)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:09.269316 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:09.363692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:09.484055 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e837a80cbe41a98c025412095fe9cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.484715 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e837a80cbe41a98c025412095fe9cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.485325 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e837a80cbe41a98c025412095fe9cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.556039 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e837a80cbe41a98c025412095fe9cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.569452 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-7225a0e7-e4a6-472f-80d3-ec8942e71d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e837a80cbe41a98c025412095fe9cd'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:09.582457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1423/2839] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:09 2022] DELETE /identity/v3/users/e2e837a80cbe41a98c025412095fe9cd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:09.992184 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:09.993763 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:10.008804 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753ccf9-754e-4e4f-a9fd-26eb9863e4fb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.066856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.072654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.072654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.072654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] PATH_INFO: `/v3/projects/de2d3933bd0d4e0a9389868681fbd0e7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.072654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2d3933bd0d4e0a9389868681fbd0e7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.072654 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.168963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2d3933bd0d4e0a9389868681fbd0e7', 'request_id': 'req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:10.174297 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2d3933bd0d4e0a9389868681fbd0e7', 'request_id': 'req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:10.219053 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2d3933bd0d4e0a9389868681fbd0e7', 'request_id': 'req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:10.231488 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] The token cache is being invalidate because project de2d3933bd0d4e0a9389868681fbd0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:10.231777 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:10.232415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b2e192c9-b2b8-4d88-80ff-f8f20969a65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:10.233958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1417/2840] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:09 2022] DELETE /identity/v3/projects/de2d3933bd0d4e0a9389868681fbd0e7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:10.239041 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae3b8-8787-4d23-8d00-7a5fd16a9fa4 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.239500 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae3b8-8787-4d23-8d00-7a5fd16a9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.239599 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae3b8-8787-4d23-8d00-7a5fd16a9fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.257622 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-483ae3b8-8787-4d23-8d00-7a5fd16a9fa4 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:10.258880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-483ae3b8-8787-4d23-8d00-7a5fd16a9fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:10.319789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1424/2841] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:10.379196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ff02-05e2-423e-8928-a1231d1658fb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.379492 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ff02-05e2-423e-8928-a1231d1658fb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.379779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548ff02-05e2-423e-8928-a1231d1658fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.398826 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b548ff02-05e2-423e-8928-a1231d1658fb None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:10.400036 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b548ff02-05e2-423e-8928-a1231d1658fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:10.408874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1418/2842] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:10.413036 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ae3b8-8787-4d23-8d00-7a5fd16a9fa4 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:10.422854 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ae3b8-8787-4d23-8d00-7a5fd16a9fa4 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.427503 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.428154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.428438 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.428727 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] PATH_INFO: `/v3/domains` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.429483 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80310) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:10.429796 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.431417 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.443291 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1425/2843] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:10.448162 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548ff02-05e2-423e-8928-a1231d1658fb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:10.457501 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548ff02-05e2-423e-8928-a1231d1658fb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.462280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323243f-4b41-4e94-9f8e-06914ef7638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.462925 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323243f-4b41-4e94-9f8e-06914ef7638f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.463849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323243f-4b41-4e94-9f8e-06914ef7638f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.464197 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323243f-4b41-4e94-9f8e-06914ef7638f admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.464912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323243f-4b41-4e94-9f8e-06914ef7638f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.466851 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323243f-4b41-4e94-9f8e-06914ef7638f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.529362 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1419/2844] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:10 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:10.533647 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:10.544406 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0532b-cb5e-4af4-acf4-3b57768f6298 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.600865 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ac664-e2f4-4980-86d5-272aa5f86daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.601535 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ac664-e2f4-4980-86d5-272aa5f86daa admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.601832 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ac664-e2f4-4980-86d5-272aa5f86daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.602121 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ac664-e2f4-4980-86d5-272aa5f86daa admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.602810 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ac664-e2f4-4980-86d5-272aa5f86daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.604880 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ac664-e2f4-4980-86d5-272aa5f86daa admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.682634 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1426/2845] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:10 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:10.686838 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323243f-4b41-4e94-9f8e-06914ef7638f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:10.697235 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323243f-4b41-4e94-9f8e-06914ef7638f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.702696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f0757-44cc-4316-b4e8-6633e7498a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.703358 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0757-44cc-4316-b4e8-6633e7498a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.703644 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0757-44cc-4316-b4e8-6633e7498a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.703952 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0757-44cc-4316-b4e8-6633e7498a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.704685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f0757-44cc-4316-b4e8-6633e7498a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.706312 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f0757-44cc-4316-b4e8-6633e7498a9c admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.717542 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1420/2846] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:10.721778 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ac664-e2f4-4980-86d5-272aa5f86daa admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:10.732493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ac664-e2f4-4980-86d5-272aa5f86daa admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.737239 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22992114-a382-4b58-b5b9-8d04debc0079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.737889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992114-a382-4b58-b5b9-8d04debc0079 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.738213 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992114-a382-4b58-b5b9-8d04debc0079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.738490 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22992114-a382-4b58-b5b9-8d04debc0079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.739210 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22992114-a382-4b58-b5b9-8d04debc0079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.740766 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22992114-a382-4b58-b5b9-8d04debc0079 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.751323 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1427/2847] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:10.755379 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f0757-44cc-4316-b4e8-6633e7498a9c admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:10.761327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:10.767178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f0757-44cc-4316-b4e8-6633e7498a9c admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:10.772063 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129797ec-831f-4c85-adc3-ef4112d48c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:10.774643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129797ec-831f-4c85-adc3-ef4112d48c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.774643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129797ec-831f-4c85-adc3-ef4112d48c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.774643 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129797ec-831f-4c85-adc3-ef4112d48c5a admin admin] PATH_INFO: `/v3/projects/59b12c5b57014e70af46ba3b1c489b9e/users/c7c0cd5fef424b929c63ff60c39cb36d/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.791860 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129797ec-831f-4c85-adc3-ef4112d48c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b12c5b57014e70af46ba3b1c489b9e, user_id=c7c0cd5fef424b929c63ff60c39cb36d, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:10.792485 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129797ec-831f-4c85-adc3-ef4112d48c5a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:10.843144 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1421/2848] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:10 2022] PUT /identity/v3/projects/59b12c5b57014e70af46ba3b1c489b9e/users/c7c0cd5fef424b929c63ff60c39cb36d/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:10.853680 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6ff4-3d27-4803-b791-af2e21f70fb2 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:10.853971 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6ff4-3d27-4803-b791-af2e21f70fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:10.854376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b6ff4-3d27-4803-b791-af2e21f70fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:10.874598 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:10.881980 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-066b6ff4-3d27-4803-b791-af2e21f70fb2 None None] MFA Rules not processed for user `c7c0cd5fef424b929c63ff60c39cb36d`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:10.883200 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-066b6ff4-3d27-4803-b791-af2e21f70fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:10.947682 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1428/2849] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:10.991112 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129797ec-831f-4c85-adc3-ef4112d48c5a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:11.053478 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129797ec-831f-4c85-adc3-ef4112d48c5a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:11.058129 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923aff9-13e3-4552-a14d-533670b3e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:11.059325 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aff9-13e3-4552-a14d-533670b3e070 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:11.059606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aff9-13e3-4552-a14d-533670b3e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:11.059882 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923aff9-13e3-4552-a14d-533670b3e070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:11.060568 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923aff9-13e3-4552-a14d-533670b3e070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:11.062481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923aff9-13e3-4552-a14d-533670b3e070 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:11.146393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1422/2850] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:10 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:11.150585 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6ff4-3d27-4803-b791-af2e21f70fb2 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:11.161563 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b6ff4-3d27-4803-b791-af2e21f70fb2 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:11.217172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549460-b99d-49f0-8886-35700595c15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:11.217848 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549460-b99d-49f0-8886-35700595c15c admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:11.218167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549460-b99d-49f0-8886-35700595c15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:11.218454 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549460-b99d-49f0-8886-35700595c15c admin admin] PATH_INFO: `/v3/users` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:11.219154 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0549460-b99d-49f0-8886-35700595c15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:11.221311 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0549460-b99d-49f0-8886-35700595c15c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:11.293895 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1429/2851] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:11 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:11.297972 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923aff9-13e3-4552-a14d-533670b3e070 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:11.309324 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923aff9-13e3-4552-a14d-533670b3e070 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:11.313913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416265f-5d69-4177-9f72-c163fbb6e9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:11.314600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416265f-5d69-4177-9f72-c163fbb6e9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:11.314885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416265f-5d69-4177-9f72-c163fbb6e9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:11.315163 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416265f-5d69-4177-9f72-c163fbb6e9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:11.315891 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416265f-5d69-4177-9f72-c163fbb6e9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:11.317467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416265f-5d69-4177-9f72-c163fbb6e9d5 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:11.328005 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1423/2852] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:11.332190 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549460-b99d-49f0-8886-35700595c15c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:11.342450 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549460-b99d-49f0-8886-35700595c15c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:11.347340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235d53-6188-425a-b2e4-11d349ed7731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:11.348208 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235d53-6188-425a-b2e4-11d349ed7731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:11.348493 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235d53-6188-425a-b2e4-11d349ed7731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:11.348771 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235d53-6188-425a-b2e4-11d349ed7731 admin admin] PATH_INFO: `/v3/projects/d8fbb7ba9e2347778469a7117ee2f330/users/3cffdfaac813478c9027bf6dacc9b847/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:11.363827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8235d53-6188-425a-b2e4-11d349ed7731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fbb7ba9e2347778469a7117ee2f330, user_id=3cffdfaac813478c9027bf6dacc9b847, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:11.366465 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8235d53-6188-425a-b2e4-11d349ed7731 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:11.430638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1430/2853] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:11 2022] PUT /identity/v3/projects/d8fbb7ba9e2347778469a7117ee2f330/users/3cffdfaac813478c9027bf6dacc9b847/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:15:11.435334 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416265f-5d69-4177-9f72-c163fbb6e9d5 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:11.445241 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416265f-5d69-4177-9f72-c163fbb6e9d5 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:11.503030 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436ae1a-02aa-438c-af2f-1b668ac647db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:11.503696 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ae1a-02aa-438c-af2f-1b668ac647db admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:11.503980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ae1a-02aa-438c-af2f-1b668ac647db admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:11.504259 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436ae1a-02aa-438c-af2f-1b668ac647db admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:11.504978 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436ae1a-02aa-438c-af2f-1b668ac647db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:11.506609 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436ae1a-02aa-438c-af2f-1b668ac647db admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:11.516106 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1424/2854] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:11.520517 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235d53-6188-425a-b2e4-11d349ed7731 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:11.531458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235d53-6188-425a-b2e4-11d349ed7731 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:11.536003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:11.536878 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:11.537156 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:11.537432 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] PATH_INFO: `/v3/projects/d8fbb7ba9e2347778469a7117ee2f330/users/3cffdfaac813478c9027bf6dacc9b847/roles/5bb1ede17a1d426089367e9741ae3c9b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:11.539387 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fbb7ba9e2347778469a7117ee2f330, user_id=3cffdfaac813478c9027bf6dacc9b847, role_id=5bb1ede17a1d426089367e9741ae3c9b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:11.541959 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:11.553237 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1431/2855] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:11 2022] PUT /identity/v3/projects/d8fbb7ba9e2347778469a7117ee2f330/users/3cffdfaac813478c9027bf6dacc9b847/roles/5bb1ede17a1d426089367e9741ae3c9b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:11.563507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08836905-d7b5-47eb-be69-61fe18390339 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:11.563746 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08836905-d7b5-47eb-be69-61fe18390339 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:11.564035 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08836905-d7b5-47eb-be69-61fe18390339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:11.590761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-08836905-d7b5-47eb-be69-61fe18390339 None None] MFA Rules not processed for user `3cffdfaac813478c9027bf6dacc9b847`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:11.592003 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-08836905-d7b5-47eb-be69-61fe18390339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:11.630856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:11.661299 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1425/2856] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:11.672560 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:11.674287 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:11.734113 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26ebfd-cb0c-4c20-a992-60b3303d540a admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:11.737881 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700584a-424c-41b6-8eef-6ccb95dd5a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:11.738554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700584a-424c-41b6-8eef-6ccb95dd5a22 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:11.738837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700584a-424c-41b6-8eef-6ccb95dd5a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:11.739137 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700584a-424c-41b6-8eef-6ccb95dd5a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:11.744464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:11.796258 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700584a-424c-41b6-8eef-6ccb95dd5a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:11.797693 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700584a-424c-41b6-8eef-6ccb95dd5a22 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:11.806840 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1432/2857] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 09:15:14.848507 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08836905-d7b5-47eb-be69-61fe18390339 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:14.910583 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08836905-d7b5-47eb-be69-61fe18390339 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:14.915151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:14.916011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:14.916292 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:14.916562 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] PATH_INFO: `/v3/users/c7c0cd5fef424b929c63ff60c39cb36d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:14.917945 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c0cd5fef424b929c63ff60c39cb36d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:14.920012 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:15.159499 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c0cd5fef424b929c63ff60c39cb36d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.160220 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c0cd5fef424b929c63ff60c39cb36d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.167134 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c0cd5fef424b929c63ff60c39cb36d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.167796 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c0cd5fef424b929c63ff60c39cb36d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.235968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c0cd5fef424b929c63ff60c39cb36d'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.254391 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1426/2858] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:14 2022] DELETE /identity/v3/users/c7c0cd5fef424b929c63ff60c39cb36d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:15.258926 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87e105-f8c0-44c9-979e-256fbb4c42fa None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:15.259415 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87e105-f8c0-44c9-979e-256fbb4c42fa None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:15.259514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87e105-f8c0-44c9-979e-256fbb4c42fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:15.276812 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7b87e105-f8c0-44c9-979e-256fbb4c42fa None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:15.278003 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7b87e105-f8c0-44c9-979e-256fbb4c42fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:15.338382 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1433/2859] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:15.348849 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:15.350393 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:15.407208 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699189e-65da-411f-b843-89b3cb3ea897 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:15.410893 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b98f0-c742-44dd-8ac0-82f5e1b1fcc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:15.411471 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b98f0-c742-44dd-8ac0-82f5e1b1fcc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:15.411757 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b98f0-c742-44dd-8ac0-82f5e1b1fcc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:15.412049 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b98f0-c742-44dd-8ac0-82f5e1b1fcc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:15.419718 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:15.422406 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b98f0-c742-44dd-8ac0-82f5e1b1fcc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:15.423839 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b98f0-c742-44dd-8ac0-82f5e1b1fcc5 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:15.433739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1427/2860] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:15.850637 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87e105-f8c0-44c9-979e-256fbb4c42fa None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:15.852172 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7b87e105-f8c0-44c9-979e-256fbb4c42fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:15.865600 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87e105-f8c0-44c9-979e-256fbb4c42fa None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:15.870663 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:15.871528 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:15.871845 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:15.872177 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] PATH_INFO: `/v3/projects/59b12c5b57014e70af46ba3b1c489b9e` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:15.873402 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b12c5b57014e70af46ba3b1c489b9e)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:15.875496 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:15.979336 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b12c5b57014e70af46ba3b1c489b9e', 'request_id': 'req-072aa260-3329-43fd-84d2-91580fb78c3c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.985597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b12c5b57014e70af46ba3b1c489b9e', 'request_id': 'req-072aa260-3329-43fd-84d2-91580fb78c3c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:15.991119 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b12c5b57014e70af46ba3b1c489b9e', 'request_id': 'req-072aa260-3329-43fd-84d2-91580fb78c3c'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.213310 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] The token cache is being invalidate because project 59b12c5b57014e70af46ba3b1c489b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:16.213648 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.214249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.215825 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1434/2861] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:15 2022] DELETE /identity/v3/projects/59b12c5b57014e70af46ba3b1c489b9e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:16.220167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b98f0-c742-44dd-8ac0-82f5e1b1fcc5 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:16.230452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b98f0-c742-44dd-8ac0-82f5e1b1fcc5 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:16.286712 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:16.287584 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:16.287869 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:16.288151 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] PATH_INFO: `/v3/users/3cffdfaac813478c9027bf6dacc9b847` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:16.289340 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cffdfaac813478c9027bf6dacc9b847)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:16.291286 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:16.474265 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cffdfaac813478c9027bf6dacc9b847'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.475013 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cffdfaac813478c9027bf6dacc9b847'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.482680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cffdfaac813478c9027bf6dacc9b847'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.483258 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cffdfaac813478c9027bf6dacc9b847'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.555933 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-dea26212-1071-47ac-abd1-40970d743c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cffdfaac813478c9027bf6dacc9b847'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:16.574767 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1428/2862] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:16 2022] DELETE /identity/v3/users/3cffdfaac813478c9027bf6dacc9b847 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:17.015138 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.016690 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.030367 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa260-3329-43fd-84d2-91580fb78c3c admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.062430 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:17.093582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.094492 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.094774 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.095047 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] PATH_INFO: `/v3/projects/d8fbb7ba9e2347778469a7117ee2f330` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.096559 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fbb7ba9e2347778469a7117ee2f330)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.099248 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.219735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fbb7ba9e2347778469a7117ee2f330', 'request_id': 'req-da34d072-58f4-46f5-aca7-4a5172cef0fe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.226136 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fbb7ba9e2347778469a7117ee2f330', 'request_id': 'req-da34d072-58f4-46f5-aca7-4a5172cef0fe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.232544 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fbb7ba9e2347778469a7117ee2f330', 'request_id': 'req-da34d072-58f4-46f5-aca7-4a5172cef0fe'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.303883 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] The token cache is being invalidate because project d8fbb7ba9e2347778469a7117ee2f330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:17.304087 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.304703 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-da34d072-58f4-46f5-aca7-4a5172cef0fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:17.306312 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1435/2863] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:17 2022] DELETE /identity/v3/projects/d8fbb7ba9e2347778469a7117ee2f330 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:17.311415 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294d57-a711-4999-8c04-0d86bbabfc20 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.311909 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294d57-a711-4999-8c04-0d86bbabfc20 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.312016 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294d57-a711-4999-8c04-0d86bbabfc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.330480 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-70294d57-a711-4999-8c04-0d86bbabfc20 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:17.331665 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-70294d57-a711-4999-8c04-0d86bbabfc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.393281 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1429/2864] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:17.402105 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967fe2-dd5e-41f3-b4a1-574c3b5ee595 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.402408 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967fe2-dd5e-41f3-b4a1-574c3b5ee595 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.402736 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967fe2-dd5e-41f3-b4a1-574c3b5ee595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.421582 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-76967fe2-dd5e-41f3-b4a1-574c3b5ee595 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:17.422808 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-76967fe2-dd5e-41f3-b4a1-574c3b5ee595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:17.430659 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1436/2865] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:17.435580 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70294d57-a711-4999-8c04-0d86bbabfc20 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.445327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70294d57-a711-4999-8c04-0d86bbabfc20 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.450044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.451447 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.451728 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.452006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.452730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:17.453039 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.454680 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.466317 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1430/2866] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:17.470945 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967fe2-dd5e-41f3-b4a1-574c3b5ee595 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.480072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967fe2-dd5e-41f3-b4a1-574c3b5ee595 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.484728 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bad76-9b2a-4ec7-a885-db4fb64dc3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.485366 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bad76-9b2a-4ec7-a885-db4fb64dc3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.485643 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bad76-9b2a-4ec7-a885-db4fb64dc3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.485916 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bad76-9b2a-4ec7-a885-db4fb64dc3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.486641 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bad76-9b2a-4ec7-a885-db4fb64dc3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.488515 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bad76-9b2a-4ec7-a885-db4fb64dc3a2 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.598320 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1437/2867] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:17 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:15:17.603395 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.608912 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:17.614463 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00776e65-6999-487a-9fc1-cbc34278a1c1 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.793539 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026ed4e-8685-437b-9f1a-c76dcd3413dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.794779 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ed4e-8685-437b-9f1a-c76dcd3413dd admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.795068 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ed4e-8685-437b-9f1a-c76dcd3413dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.795345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ed4e-8685-437b-9f1a-c76dcd3413dd admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.796044 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026ed4e-8685-437b-9f1a-c76dcd3413dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.797939 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026ed4e-8685-437b-9f1a-c76dcd3413dd admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.887820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1431/2868] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:17 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:17.892102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bad76-9b2a-4ec7-a885-db4fb64dc3a2 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.902476 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bad76-9b2a-4ec7-a885-db4fb64dc3a2 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.907559 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9bb98-5be6-47f2-bc6c-8bd31c2a0ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.908226 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9bb98-5be6-47f2-bc6c-8bd31c2a0ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.908514 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9bb98-5be6-47f2-bc6c-8bd31c2a0ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.908917 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9bb98-5be6-47f2-bc6c-8bd31c2a0ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.909657 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9bb98-5be6-47f2-bc6c-8bd31c2a0ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.911283 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9bb98-5be6-47f2-bc6c-8bd31c2a0ac0 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.922488 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1438/2869] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:17.926555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026ed4e-8685-437b-9f1a-c76dcd3413dd admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.937315 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026ed4e-8685-437b-9f1a-c76dcd3413dd admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.941915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aada3a-f653-4be2-bf32-41c516710805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.942634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aada3a-f653-4be2-bf32-41c516710805 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.942915 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aada3a-f653-4be2-bf32-41c516710805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.943196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aada3a-f653-4be2-bf32-41c516710805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.943913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aada3a-f653-4be2-bf32-41c516710805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.945481 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aada3a-f653-4be2-bf32-41c516710805 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:17.955555 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1432/2870] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:17.959630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9bb98-5be6-47f2-bc6c-8bd31c2a0ac0 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:17.969631 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9bb98-5be6-47f2-bc6c-8bd31c2a0ac0 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:17.974763 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:17.975661 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:17.975944 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:17.976218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] PATH_INFO: `/v3/projects/c7f3436b66e9447a8b1ea4129392535b/users/5828a6925f2646b18bd33c74a4d9ec30/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:17.991277 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f3436b66e9447a8b1ea4129392535b, user_id=5828a6925f2646b18bd33c74a4d9ec30, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:17.993893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.071153 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1439/2871] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:17 2022] PUT /identity/v3/projects/c7f3436b66e9447a8b1ea4129392535b/users/5828a6925f2646b18bd33c74a4d9ec30/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:18.081321 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608437f6-829e-4f7c-8d12-9eeac5d7ede1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.081605 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608437f6-829e-4f7c-8d12-9eeac5d7ede1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.081913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608437f6-829e-4f7c-8d12-9eeac5d7ede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.108326 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-608437f6-829e-4f7c-8d12-9eeac5d7ede1 None None] MFA Rules not processed for user `5828a6925f2646b18bd33c74a4d9ec30`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:18.109532 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-608437f6-829e-4f7c-8d12-9eeac5d7ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.172792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1433/2872] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:18.183928 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.185822 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.243861 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2bd9-0c68-48f4-bf7f-e3d67058ad4d admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.247538 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524dcf7-51bb-4cfc-96e0-aa888f7d61dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.248198 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524dcf7-51bb-4cfc-96e0-aa888f7d61dd service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.248480 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524dcf7-51bb-4cfc-96e0-aa888f7d61dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.248754 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524dcf7-51bb-4cfc-96e0-aa888f7d61dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.257001 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524dcf7-51bb-4cfc-96e0-aa888f7d61dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.258444 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524dcf7-51bb-4cfc-96e0-aa888f7d61dd service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.262889 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:18.267756 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1440/2873] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:18.292075 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608437f6-829e-4f7c-8d12-9eeac5d7ede1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.353962 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608437f6-829e-4f7c-8d12-9eeac5d7ede1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.359279 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.360148 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.360430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.360705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] PATH_INFO: `/v3/users/5828a6925f2646b18bd33c74a4d9ec30` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.361902 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5828a6925f2646b18bd33c74a4d9ec30)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.363837 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.376428 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:18.508059 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5828a6925f2646b18bd33c74a4d9ec30'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.508730 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5828a6925f2646b18bd33c74a4d9ec30'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.515921 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5828a6925f2646b18bd33c74a4d9ec30'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.516573 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5828a6925f2646b18bd33c74a4d9ec30'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.585064 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5828a6925f2646b18bd33c74a4d9ec30'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:18.606980 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1434/2874] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:18 2022] DELETE /identity/v3/users/5828a6925f2646b18bd33c74a4d9ec30 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:18.611837 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e65e8-2d15-4c28-addb-0f3b2a4582a9 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.616664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e65e8-2d15-4c28-addb-0f3b2a4582a9 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.616664 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e65e8-2d15-4c28-addb-0f3b2a4582a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.629922 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-7e1e65e8-2d15-4c28-addb-0f3b2a4582a9 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:18.631160 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7e1e65e8-2d15-4c28-addb-0f3b2a4582a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.691899 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1441/2875] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:18.702176 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:18.703684 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:18.764082 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9563141-e416-45e1-be0c-5d0e35a13a4d admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:18.767958 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47df580-d0c4-4100-b036-91f087c04b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:18.768634 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47df580-d0c4-4100-b036-91f087c04b6c service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:18.768932 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47df580-d0c4-4100-b036-91f087c04b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:18.769264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47df580-d0c4-4100-b036-91f087c04b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:18.779327 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47df580-d0c4-4100-b036-91f087c04b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:18.783038 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47df580-d0c4-4100-b036-91f087c04b6c service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:18.790554 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1435/2876] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:19.244696 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e65e8-2d15-4c28-addb-0f3b2a4582a9 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.246328 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-7e1e65e8-2d15-4c28-addb-0f3b2a4582a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:19.259597 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e65e8-2d15-4c28-addb-0f3b2a4582a9 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.264484 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.265351 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.265630 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.265905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] PATH_INFO: `/v3/projects/c7f3436b66e9447a8b1ea4129392535b` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.267181 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f3436b66e9447a8b1ea4129392535b)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.269115 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.379725 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f3436b66e9447a8b1ea4129392535b', 'request_id': 'req-ff58d4f3-0f7e-4721-8995-2b922d983950'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:19.385941 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f3436b66e9447a8b1ea4129392535b', 'request_id': 'req-ff58d4f3-0f7e-4721-8995-2b922d983950'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:19.392249 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f3436b66e9447a8b1ea4129392535b', 'request_id': 'req-ff58d4f3-0f7e-4721-8995-2b922d983950'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:19.463902 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] The token cache is being invalidate because project c7f3436b66e9447a8b1ea4129392535b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:19.464188 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:19.464798 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-ff58d4f3-0f7e-4721-8995-2b922d983950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:19.467013 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1442/2877] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:19 2022] DELETE /identity/v3/projects/c7f3436b66e9447a8b1ea4129392535b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:19.472139 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e243f2-d9a7-45aa-a678-bfafe5d80bf8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.472819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e243f2-d9a7-45aa-a678-bfafe5d80bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.472819 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e243f2-d9a7-45aa-a678-bfafe5d80bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.490418 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-16e243f2-d9a7-45aa-a678-bfafe5d80bf8 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:19.491600 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-16e243f2-d9a7-45aa-a678-bfafe5d80bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:19.549614 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1436/2878] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:19.557401 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e52d-f46c-4fa6-97e5-5cc9512d5318 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.557695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e52d-f46c-4fa6-97e5-5cc9512d5318 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.557999 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940e52d-f46c-4fa6-97e5-5cc9512d5318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.576746 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-0940e52d-f46c-4fa6-97e5-5cc9512d5318 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:19.577946 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-0940e52d-f46c-4fa6-97e5-5cc9512d5318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:19.585807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1443/2879] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:19.589953 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e243f2-d9a7-45aa-a678-bfafe5d80bf8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.600280 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e243f2-d9a7-45aa-a678-bfafe5d80bf8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.604937 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.605592 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.605871 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.606178 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.606963 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:15:19.607275 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.608881 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.620887 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1437/2880] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 22 09:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:15:19.625280 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e52d-f46c-4fa6-97e5-5cc9512d5318 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.634898 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940e52d-f46c-4fa6-97e5-5cc9512d5318 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.640149 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae878cf9-c446-436f-afac-7a5881744472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.640807 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae878cf9-c446-436f-afac-7a5881744472 admin admin] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.641094 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae878cf9-c446-436f-afac-7a5881744472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.641374 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae878cf9-c446-436f-afac-7a5881744472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.642106 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae878cf9-c446-436f-afac-7a5881744472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.643995 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae878cf9-c446-436f-afac-7a5881744472 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.752997 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1444/2881] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 22 09:15:19 2022] POST /identity/v3/projects => generated 399 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:19.757023 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.768074 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc32a4b-9c24-45c4-bd22-855c2f5d04fb admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.785872 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:19.825187 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02afb91-65d3-49cc-abf5-63c63a756a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.826599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02afb91-65d3-49cc-abf5-63c63a756a74 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.826885 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02afb91-65d3-49cc-abf5-63c63a756a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.827167 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02afb91-65d3-49cc-abf5-63c63a756a74 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.827876 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02afb91-65d3-49cc-abf5-63c63a756a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.829792 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02afb91-65d3-49cc-abf5-63c63a756a74 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.916629 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1438/2882] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 22 09:15:19 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:15:19.920984 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae878cf9-c446-436f-afac-7a5881744472 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.931327 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae878cf9-c446-436f-afac-7a5881744472 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.936892 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c6c41-5ab6-4244-8cb8-0c7e488e0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.937569 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c6c41-5ab6-4244-8cb8-0c7e488e0864 admin admin] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.937851 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c6c41-5ab6-4244-8cb8-0c7e488e0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.938158 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c6c41-5ab6-4244-8cb8-0c7e488e0864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.938884 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c6c41-5ab6-4244-8cb8-0c7e488e0864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.940451 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c6c41-5ab6-4244-8cb8-0c7e488e0864 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.951711 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1445/2883] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 09:15:19.955874 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02afb91-65d3-49cc-abf5-63c63a756a74 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.965820 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02afb91-65d3-49cc-abf5-63c63a756a74 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:19.970691 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47d9cb-86dc-4136-96a1-5a269d1ab1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:19.971345 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47d9cb-86dc-4136-96a1-5a269d1ab1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:19.971633 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47d9cb-86dc-4136-96a1-5a269d1ab1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:19.971913 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47d9cb-86dc-4136-96a1-5a269d1ab1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:19.972663 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47d9cb-86dc-4136-96a1-5a269d1ab1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:19.974266 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47d9cb-86dc-4136-96a1-5a269d1ab1ae admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:19.984446 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1439/2884] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 22 09:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 09:15:19.988581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c6c41-5ab6-4244-8cb8-0c7e488e0864 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:19.999410 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c6c41-5ab6-4244-8cb8-0c7e488e0864 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.004186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.005069 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.005353 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.005632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] PATH_INFO: `/v3/projects/d2871f4e451848e894d94085c6ba5824/users/e234dc62450e47ebbfa91df5e8fb8868/roles/d9de94a33cd64dc88a723f03480c9e17` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.022863 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2871f4e451848e894d94085c6ba5824, user_id=e234dc62450e47ebbfa91df5e8fb8868, role_id=d9de94a33cd64dc88a723f03480c9e17)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.025640 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.105073 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1446/2885] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 22 09:15:19 2022] PUT /identity/v3/projects/d2871f4e451848e894d94085c6ba5824/users/e234dc62450e47ebbfa91df5e8fb8868/roles/d9de94a33cd64dc88a723f03480c9e17 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:20.116685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2fbb-dffd-4f63-83a1-1b925c2f626d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.116976 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2fbb-dffd-4f63-83a1-1b925c2f626d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.117254 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc2fbb-dffd-4f63-83a1-1b925c2f626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.144867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-59fc2fbb-dffd-4f63-83a1-1b925c2f626d None None] MFA Rules not processed for user `e234dc62450e47ebbfa91df5e8fb8868`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:20.146052 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-59fc2fbb-dffd-4f63-83a1-1b925c2f626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:20.209165 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1440/2886] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:20.220994 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:20.222783 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:20.246409 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:20.282551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fe5cc-f8be-4b0b-9399-681b422bb303 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:20.286439 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4939c4-2c4b-43b3-88b6-a3601a28dc7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:20.287084 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4939c4-2c4b-43b3-88b6-a3601a28dc7a service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:20.287364 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4939c4-2c4b-43b3-88b6-a3601a28dc7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:20.287638 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4939c4-2c4b-43b3-88b6-a3601a28dc7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:20.297015 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4939c4-2c4b-43b3-88b6-a3601a28dc7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:20.298466 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4939c4-2c4b-43b3-88b6-a3601a28dc7a service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:20.307218 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1447/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:28.121594 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc2fbb-dffd-4f63-83a1-1b925c2f626d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:28.184420 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc2fbb-dffd-4f63-83a1-1b925c2f626d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:28.189006 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:28.189864 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:28.190174 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:28.190452 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] PATH_INFO: `/v3/users/e234dc62450e47ebbfa91df5e8fb8868` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:28.191627 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e234dc62450e47ebbfa91df5e8fb8868)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:28.193510 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:28.339686 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:28.353179 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e234dc62450e47ebbfa91df5e8fb8868'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:28.353856 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e234dc62450e47ebbfa91df5e8fb8868'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:28.360967 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e234dc62450e47ebbfa91df5e8fb8868'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:28.361608 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e234dc62450e47ebbfa91df5e8fb8868'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:28.430192 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e234dc62450e47ebbfa91df5e8fb8868'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:28.447968 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1441/2888] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:15:28 2022] DELETE /identity/v3/users/e234dc62450e47ebbfa91df5e8fb8868 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:28.452960 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f195c4-6bd5-44c0-8dbd-6e4154a13e11 None None] REQUEST_METHOD: `POST` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:28.453458 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f195c4-6bd5-44c0-8dbd-6e4154a13e11 None None] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:28.453573 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f195c4-6bd5-44c0-8dbd-6e4154a13e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:28.471780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.auth.core [None req-82f195c4-6bd5-44c0-8dbd-6e4154a13e11 None None] MFA Rules not processed for user `4eee573b0bd94bdf970811c775ee4f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80310) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:28.472990 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-82f195c4-6bd5-44c0-8dbd-6e4154a13e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:28.532303 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1448/2889] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:28.542357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:28.543768 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:28.603120 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20535fdc-09d6-4a51-9343-2030b647f33a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:28.606761 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29beef9-5667-4add-ad8f-c563227e8498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:28.607549 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29beef9-5667-4add-ad8f-c563227e8498 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:28.607835 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29beef9-5667-4add-ad8f-c563227e8498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:28.608108 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29beef9-5667-4add-ad8f-c563227e8498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:28.617019 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29beef9-5667-4add-ad8f-c563227e8498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:28.618467 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29beef9-5667-4add-ad8f-c563227e8498 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:28.628196 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1442/2890] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:29.037908 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f195c4-6bd5-44c0-8dbd-6e4154a13e11 None None] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:29.039370 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-82f195c4-6bd5-44c0-8dbd-6e4154a13e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:29.053730 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f195c4-6bd5-44c0-8dbd-6e4154a13e11 None None] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:29.058590 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:29.060506 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:29.060794 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:29.061243 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] PATH_INFO: `/v3/projects/d2871f4e451848e894d94085c6ba5824` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:29.062376 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2871f4e451848e894d94085c6ba5824)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:29.064321 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:29.162559 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2871f4e451848e894d94085c6ba5824', 'request_id': 'req-5f4107d7-d750-4be7-9f30-8100c70a0ee3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:29.168601 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2871f4e451848e894d94085c6ba5824', 'request_id': 'req-5f4107d7-d750-4be7-9f30-8100c70a0ee3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:29.174302 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2871f4e451848e894d94085c6ba5824', 'request_id': 'req-5f4107d7-d750-4be7-9f30-8100c70a0ee3'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:29.241343 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] The token cache is being invalidate because project d2871f4e451848e894d94085c6ba5824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:15:29.241708 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:29.242331 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:15:29.244034 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1449/2891] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:15:29 2022] DELETE /identity/v3/projects/d2871f4e451848e894d94085c6ba5824 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:15:38.623700 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:39.238155 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:15:53.940533 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b9ad9-5be0-44d3-af63-56fea7d17912 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:53.941103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b9ad9-5be0-44d3-af63-56fea7d17912 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:53.941103 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b9ad9-5be0-44d3-af63-56fea7d17912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:53.958752 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d78b9ad9-5be0-44d3-af63-56fea7d17912 None None] MFA Rules not processed for user `23089387f4fd454c9a785ff4d51f48c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:15:53.959955 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d78b9ad9-5be0-44d3-af63-56fea7d17912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:54.014705 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1443/2892] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 22 09:15:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 09:15:54.052120 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:54.053554 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:54.112140 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4107d7-d750-4be7-9f30-8100c70a0ee3 admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:54.115695 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b95f073ece04f57a0c27cd3f5dd00cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:54.116340 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:54.116625 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:54.116905 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:54.118709 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:54.209063 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:54.210525 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:54.231216 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1450/2893] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:15:55.230011 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b9ad9-5be0-44d3-af63-56fea7d17912 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:15:55.231564 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d78b9ad9-5be0-44d3-af63-56fea7d17912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:55.289606 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b9ad9-5be0-44d3-af63-56fea7d17912 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:15:55.293210 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:15:55.293861 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:15:55.294180 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:15:55.294462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:15:55.296263 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:15:55.311079 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:15:55.312503 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:15:55.324365 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1444/2894] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:15:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:04.228551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=66 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:05.319430 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=51 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:13.648186 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:13.649827 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.668046 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a42ae-4902-4b8b-ab76-a2229e40e995 service cinder] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:13.675071 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:13.675749 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:13.677780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:13.677780 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:13.678176 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:13.690806 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:13.692551 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:13.702735 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1451/2895] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:23.698164 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:16:45.514795 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:16:45.524284 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5173e-1c7e-461c-a4d0-267ebc49c115 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:16:45.527974 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:16:45.537805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:16:45.537805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:16:45.537805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:16:45.537805 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:16:45.540668 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:16:45.542118 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:16:45.550198 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1445/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:16:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:16:55.546519 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:17:58.300977 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:17:58.314464 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46020ea9-0f9f-447b-b134-f434d70f7564 service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:17:58.323411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ade274e49f748ee8e3bec2a963cf1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:17:58.323411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:17:58.323411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:17:58.323411 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:17:58.323839 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:17:58.336775 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:17:58.338505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:17:58.350632 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1452/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:17:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:08.345436 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=6 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:11.723375 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:11.724867 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:11.735994 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9de33-59af-4ed5-8076-ac4f14a5bde4 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:11.739737 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a07eaeae594cc99cc07da7a4fc6b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:11.740370 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:11.740649 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:11.740922 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:11.742731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:11.807473 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:11.808983 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:11.819647 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1446/2898] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:15.308356 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:15.310089 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:15.400369 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a27d8a-0664-4e0a-8288-2d284cafcbaf service nova] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:15.405371 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:15.406024 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] REQUEST_METHOD: `GET` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:15.406505 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:15.406789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:15.408581 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:15.420165 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:15.421768 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:15.433178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1453/2899] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:18:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:18:19.239957 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:19.241462 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:19.253868 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1cf8f-bc6a-40ac-a24e-4ced00f98b6c service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:19.258498 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:19.259357 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:19.259636 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:19.259969 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] PATH_INFO: `/v3/users/23089387f4fd454c9a785ff4d51f48c5` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:19.261194 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=23089387f4fd454c9a785ff4d51f48c5)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:19.263121 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:19.429733 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23089387f4fd454c9a785ff4d51f48c5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:19.430495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23089387f4fd454c9a785ff4d51f48c5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:19.437660 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23089387f4fd454c9a785ff4d51f48c5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:19.438529 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23089387f4fd454c9a785ff4d51f48c5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:19.524264 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23089387f4fd454c9a785ff4d51f48c5'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:19.543599 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1447/2900] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:18:19 2022] DELETE /identity/v3/users/23089387f4fd454c9a785ff4d51f48c5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:18:19.846681 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:19.858623 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce33b7-c8c3-4687-ab19-af607a4c744d service placement] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:19.918294 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:19.919178 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:19.919462 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:19.919734 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] PATH_INFO: `/v3/projects/0c6571a499a0498abe9211d2d252bacf` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:19.920912 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6571a499a0498abe9211d2d252bacf)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:19.923066 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:20.028789 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6571a499a0498abe9211d2d252bacf', 'request_id': 'req-c4fe4748-54a1-4855-99f3-8d44e2ea542b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.036093 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6571a499a0498abe9211d2d252bacf', 'request_id': 'req-c4fe4748-54a1-4855-99f3-8d44e2ea542b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.041988 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6571a499a0498abe9211d2d252bacf', 'request_id': 'req-c4fe4748-54a1-4855-99f3-8d44e2ea542b'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.118692 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] The token cache is being invalidate because project 0c6571a499a0498abe9211d2d252bacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:18:20.118929 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.119504 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.121065 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1454/2901] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:18:19 2022] DELETE /identity/v3/projects/0c6571a499a0498abe9211d2d252bacf => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:18:20.126257 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:20.127685 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:20.141612 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f9852-15ed-412b-a998-eb055fa61f3b admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:20.200615 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:20.201495 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:20.201841 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:20.202172 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] PATH_INFO: `/v3/users/1b515d15274c49f48a94e65ddb1e96ca` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:20.203794 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b515d15274c49f48a94e65ddb1e96ca)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:20.205800 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:20.211597 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:20.379058 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b515d15274c49f48a94e65ddb1e96ca'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.379731 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b515d15274c49f48a94e65ddb1e96ca'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.386894 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b515d15274c49f48a94e65ddb1e96ca'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.405843 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b515d15274c49f48a94e65ddb1e96ca'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.558472 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b515d15274c49f48a94e65ddb1e96ca'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:20.577906 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1448/2902] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 22 09:18:20 2022] DELETE /identity/v3/users/1b515d15274c49f48a94e65ddb1e96ca => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:18:20.835431 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] Authenticating user token {{(pid=80310) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:18:20.836955 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.fernet_utils [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80310) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:18:20.852720 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4748-54a1-4855-99f3-8d44e2ea542b admin admin] Validating token access rules against request {{(pid=80310) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:18:20.873635 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:20.915383 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4eee573b0bd94bdf970811c775ee4f22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ead886d5c674d14a096a137e80b192b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80310) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:18:20.916252 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:18:20.916567 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:18:20.916893 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] PATH_INFO: `/v3/projects/d745a1fcbc8149df916dc64d9a223687` {{(pid=80310) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:18:20.918102 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d745a1fcbc8149df916dc64d9a223687)` {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:18:20.924235 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] RBAC: Authorization granted {{(pid=80310) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:18:21.051894 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd745a1fcbc8149df916dc64d9a223687', 'request_id': 'req-38f26365-eaf4-45e5-a200-128bb444007a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:21.058072 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd745a1fcbc8149df916dc64d9a223687', 'request_id': 'req-38f26365-eaf4-45e5-a200-128bb444007a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:21.064741 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd745a1fcbc8149df916dc64d9a223687', 'request_id': 'req-38f26365-eaf4-45e5-a200-128bb444007a'} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:21.152457 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] The token cache is being invalidate because project d745a1fcbc8149df916dc64d9a223687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80310) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 09:18:21.152739 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:21.153422 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG keystone.notifications [None req-38f26365-eaf4-45e5-a200-128bb444007a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80310) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 09:18:21.155032 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: [pid: 80310|app: 0|req: 1455/2903] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 22 09:18:20 2022] DELETE /identity/v3/projects/d745a1fcbc8149df916dc64d9a223687 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:18:30.574224 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:18:31.149167 dv-cinder-787296-11-iscsi devstack@keystone.service[80310]: DEBUG dbcounter [-] [80310] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:19:43.773611 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:19:43.775034 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:19:43.848739 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68ff01-aa67-4d3c-bd6b-342a624f3e94 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:19:43.907373 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72345c19-f80b-4b0d-b4ad-3946e4df4c5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0883944ff2a24f4fa51a7c06c3040f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b6bd9582004d6d87bc1e693df518bf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:19:43.907940 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345c19-f80b-4b0d-b4ad-3946e4df4c5c service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:19:43.908227 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345c19-f80b-4b0d-b4ad-3946e4df4c5c service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:19:43.908624 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345c19-f80b-4b0d-b4ad-3946e4df4c5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:19:43.910744 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-72345c19-f80b-4b0d-b4ad-3946e4df4c5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:19:43.921822 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72345c19-f80b-4b0d-b4ad-3946e4df4c5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:19:43.923433 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72345c19-f80b-4b0d-b4ad-3946e4df4c5c service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:19:43.933646 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1449/2904] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 22 09:19:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 09:19:53.929367 dv-cinder-787296-11-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=58 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}